Strange text appears when changing from the Visual Editor to the Text Editor

The character codes which are appearing in the Text Editor are representations. The characters themselves can only be seen in the Visual view, or on your website itself.

Your webpage display shouldn't be affected at all, the codes are actually a good idea to use since they display the characters no matter what your webpage's character encoding is.