Numbers are so hard. They are probably hardest part in a language.
Chinese numbers are really logical and easy to learn, but it's not easy to recognize them when listening to a speech, especially "5" and "10".
To overcome numbers really needs persistence and practice.