How to add Hindi keyboard on Sony Xperia ZR Android KitKat

Do the following to set up the Hindi keyboard on the Sony Xperia ZR running Android KitKat.
Settings -> Language and Input
Look for Xperia keyboard with International Keyboard displayed under it.
Click on the configure icon next to it.
Select Writing Languages and check or tick Hindi
In my case I have English UK also selected
Click OK.

This sets up the keyboard layout for both languages. You will be able to select the language by pressing EN near the Enter Symbol/Key on the keyboard.

This also allows you to type in Hindi in any Office app like Quickoffice. No need to install any additional keyboard for input or any fonts after rooting.