OK I found the problem.

I did What I should have done a long time ago.
I looked at the log file
and I got

Jun 2 00:22:10 www sshd[1781]: refused connect from 0.0.0.0
Jun 2 00:23:27 www sshd[1802]: refused connect from 0.0.0.0
Jun 2 00:30:03 www sshd[1864]: refused connect from 0.0.0.0
Jun 2 00:30:34 www sshd[1867]: refused connect from 0.0.0.0
Jun 2 00:31:11 www sshd[1870]: refused connect from 0.0.0.0
Jun 2 00:32:11 www sshd[1874]: refused connect from 0.0.0.0
Jun 2 00:34:45 www sshd[2683]: refused connect from 0.0.0.0
-------------------------------------------------------------
Jun 2 00:36:10 www sshd[2689]: refused connect from 0.0.0.0
Jun 2 00:36:33 www sshd[2693]: refused connect from 0.0.0.0


most of the time I was trying to connect from my own PC, as the firewall is set to minimize DOS attack it would not
do any kind of lookup, so I tried from an outside host and I got the same.

So I will look my firewall now.