Run a sniffer on your machine while this is occuring and go through the collected data
carefully.

Don't just do a straight netstat, try something like this "netstat -nao 3 > temp.txt".
This will run netstat every 3 seconds and log it to the file temp.txt.

What type of network on you on ?

Do you use Wireless ?