This problem appears in all Office versions from 2003 to 2013. Note that if you set English as the default keyboard language everything will still work even while you're switching your keyboard language to type non-English text. Ctrl+ C will change to Ctrl+ Ins and Ctrl+ V will change to Shift+ Ins) If you select a non-English language as the default keyboard language and open Microsoft Word a lot of shortcuts will change to IBM Common User Access mode (e.g. You must select English as the default keyboard language (control panel -> regional settings -> keyboard).
At last after a lot of searching on the Internet I found the solution: