Ok, this is a really old topic, so I apologize for reviving it, but I had the same problem, found this by googling and didn't like the solution presented here. Then I managed to come up with a different solution, which is still far from perfect, but at least doesn't require adding some parameter every time I launch the game. Keep in mind, I didn't get Bastion from gog, but from some humble bundle, so this might not work in gog's version. I doubt it's different though.
First of all make backups to be able to revert changes if anything bad happens:
- Save the folder "/Applications/Bastion.app/Contents/Resources/Content/Subtitles/fr" (or 'de', or 'es', or whatever language you want to change from) somewhere else
- Save the file "/Applications/Bastion.app/Contents/Resources/Content/Game/Text/HelpText.fr.xml" somewhere else
In the following I will refer to "/Applications/Bastion.app/Contents/Resources/Content" as "[Bastion]"
Now: overwrite the [Bastion]/Subtitles/fr folder with the [Bastion]/Subtitles/en folder. In the new Subtitle-folder you should have files like "Attack01.csv" and similar. All of these files have to be renamed by adding "_FR" (again, insert proper language code) right before the ".csv". So "Attack01.csv" becomes "Attack01_FR.csv". This changes all the subtitles for the narrators lines, but the menu and item descriptions still remain French (German, Spanish,...)
Therefore step two: Overwrite [Bastion]/Game/Text/HelpText.fr.xml with [Bastion]/Game/Text/HelpText.en.xml. Then open this file (the new HelpText.fr.xml) with a text editor. Right at the beginning there's a line "<HelpText lang="en">". In this line change the "en" to "fr", and save.
Done. Now everything (except for the initial text telling you, that Bastion automatically saves whenever you see the gear symbol) should be in English. I haven't played it through yet though, so there might be unforseen problems. To revert, just replace the changes with your backups.
Hope that helps other people searching for a solution to this. This really should've been an option, as someone who speaks and understands English fairly well, I find German subtitles for the English narration utterly confusing and annoying...