I can press the save game button and then load from there so long as I don't exit the game completely.

If I exit completely all saved games are lost and I have to start from scratch.

Heya,

do you hover over the save files and click it?

Also the saves are bound to your profile.
This means you need to type your name each time the same way to get the progress/files from your profile.