A julgar pelo fato de você estar usando o Ubuntu, Parece ser um bug , como também indicado pelas respostas a essa pergunta em AskUbuntu.com :
Citando a resposta original:
This appears to be the result of bug #687535, which was fixed recently in natty, and has been uploaded to both maverick and lucid as a proposed update.
https://bugs.launchpad.net/ubuntu/lucid/+source/openssh/+bug/687535
I'd encourage everyone to go there, try the test case (search for TEST CASE), and post your results both before and after installing the proposed fix. That will help the SRU team decide that verification has been done and release it as an update.
Além disso, parece haver pelo menos mais uma pessoa que passou pelo mesmo problema e a solucionou com êxito comentando a diretiva ListenAddress
específica e adicionando um ListenAddress 0.0.0.0
genérico, conforme descrito em esta postagem no blog :
[....]
My thinking is that sshd was trying to start up before the network interfaces were configured, which was causing it to fail as it had a ListenAddress directive in /etc/ssh/sshd_config.
Commenting out the specific ListenAddress directive and adding ListenAddress 0.0.0.0 to let sshd listen on any address solved the problem. The fileserver has only 1 IP address anyway.