Here are a couple of sites I really like for free, public domain downloads. Any others ?
Audio books, speeches : http://www.learnoutloud.com/Free-Audio-Video
Tonnes of old movies, many also formatted for PDA: http://www.publicdomaintorrents.com/
Enjoy!