Thanks for the reply guys. I checked the bearing (felt smooth and tight) when I took the pump out. I figured it would be obvious if they were bad, but maybe not.
I wonder why when it is cool there are no effects. At the same time, if it was temperature it would happen sooner I would think...