You might be looking for an ssh daemon and install that on your linux server.
That way you 'll be able to access it from windows or linux remotely.

Find info on sshd here : http://www2.yo-linux.com/cgi-bin/man.cgi?topic=sshdµ

In windows you need to use Putty on your remote box it's able to ssh , telnet, rlogin to remote ssh daemons.

You can download putty here : http://people.nl.linux.org/~bjs/putty/download.html

Enjoy,

***edit***

You can download Openssh here : http://lwn.net/2000/1130/a/su-openssh.php3