You just need to leave the modem, and the router turned on. Although the computer is off the other computers connected to the router will still be able to access the interwebz etc.