You probably don't need to, but it'd be a good idea. Keeping around drivers for hardware that doesnt exist typically sounds like a bad idea.