At least you can pronounce kh , many can't,so technically you have an advantage and you shouldn't complain :).

Colloquial expressions may vary within one country sometimes, take United Kingdom for example.

Some tribes in Qatar have distinct accents,but classical Arabic is understood and spoken almost everywhere in the Arab world.

BTW do you speak Xhosa ?