System Settings -> Regional Settings -> Choose your language. Alternately, you can also change your locale after you enter your user id before you enter your password on the login screen.
For GnuCash, make sure your locale is that of the country you chose when you logged in.