Santiago: What you can also do is go into your Radeon settings and gaming/global settings and switch power efficiency to off. They added this feature to prevent exactly what you are describing. Not saying this is it for sure, but it's possible, definitely something you should test.
There is no power efficiency option on my CCC, i may be wrong but it was only an option for the R9-4xxx series.
Jespersgaard: Okay. First: If you are using any mods I suggest you delete them all as they can often cause such problems (especially if they are not made for version 1.24 of the game). If you are using GOG Galaxy then use the Verify/Repair function to make sure that no files are corrupt and/or missing.
Under settings I think only two things matter with a Radeon card. As I mentioned earlier make sure to disable hairworks. Also under Ambient Occlusion I suggest you use SSAO instead of HBAO+ (HBAO+ is also an Nvidia feature). Stay far away from Vsync. Vsync forces your framerate to stay at a certain level (typically 60 FPS because this matches a 60 Hz monitor), but it can actually cause stuttering (and other issues if your specs cannot always maintain a steady 60 FPS). You should only use Vsync if your game is running at more than 60 FPS on a 60 Hz screen, because this causes "tearing" (your monitor not being able to keep up with the framerate). I would still not use Vsync even in this situation simply because it makes games feel "clunky" in my opinion.
If none of this helps make sure your computer (and in particular your graphics card) is properly cooled. Your card can handle some very high temperatures but still: Make sure nothing is off the charts. Your system may be doing fine in other games but Witcher 3 is so incredibly demanding it can reveal such deficiencies.
I'm afraid this is all the advice I can give. I sure hope some of it helps :-)
No mods installed,
I did a clean install
No hairworks, of course ;)
No HBAO or SSAO, i dont really care about the shadows option
No vsynch
Temps are about 80-85% which is normal for my card
Thing is that the problem is there even on the lowest settings, dont have it in any other games :(
Will continue to troubleshoot, thanks for trying to help. :)