I have a program that has just recently started appearing in my task mangager called agent.exe. I suspect a trojan, but haven't gotten around to gettting rid of it yet.

Like sirSub said. You windows folder does contain all of your system files, and Internet Cache. So if you don't clear you cookies, or cache every once in a while you'll have quite a bit of garbage in there taking up space.