Just noticed that for some reason the A button does not work when using a controller, and Steam running in the background. This is because of Steam handling input from the controller. But for some reason it appears to only affect the A button (X360 controller).

I closed Steam and it worked fine.

I think of this as a bug, as other non-Steam (GOG) games are fine with Steam running in the background and using a controller.