Just solved it. It had to do with my secondary monitor, which is where my layers palette was. I used this link:
https://discussions.apple.com/thread/5476222?tstart=0
and turned off all the mission control settings I don't use. Apparently it was switching monitors whenever I used the alt key.
-Lonno