ZoneAlarm doesn't have problems with me connecting to non-standards ports above 1024, but ones below that seem to cause problems (so 8383 or 8080 would be okay, but 83 wouldn't).

I have uninstalled it now anyway, my hardware firewall works much better and it protects my network even if some/all the computers are turned off.