I wonder what a faulty power supply might do to performance if the voltage was unsteady perhaps?

Try the basics, unplug everything but CPU, GPU, RAM, keyboard and mouse.
Heck, unplug the mouse.

I suppose it is worth checking all the fans are spinning properly.