Thanks to everyone for their replies. Looking at them, there were several mixed responses but I did get some good things out of it.

First off, I looked into the CompTIA Security+ exam, from what I gather this will be great way to get a "foot in the door". Secondly, a lot of people said they would do both networking and programming. Considering my current circumstance, I might try to do both programming and networking then try to get into Grad school for InfoSec. I'm currently looking at JMU!
Wish me luck!