How to fix macOS Sierra using the wrong locale

After upgrading to macOS Sierra Golden Master some programs are for some reason using any non-primary language. In my case neovim, git and other programs started to communicate with me in Swedish.

To revert it back to the old behaviour you go to System Preferences -> Language & Region and then remove any non-primary language in the list of preferred languages.