camgus-1: Even when its only this game?
Hickory: This doesn't happen at any other time, other than when you play TW3? If that is the case, check all of your other peripherals and disconnect any that you are not using while playing The Witcher 3. Sometimes drivers can go into wonky mode when certain combinations of software and peripherals combine. It's worth checking at least.
It was the steam controll config that screwed with my controller and confused the game. I dont know if it is how they have combined controller and keyboard/ mouse inputs in the game to mean the same that mede it confused but many of the other games I play seem to seperate these two.
If anyone encounters a similar probler where the game dont´t seem to know if you play with controller or keyboard go into steam big picture mode and unklick the box for the xbox- konfiguration.