If you think figures of speech do not make it difficult to learn English, this whole article section may be way out in left field to you. Think about it again. How many different ways can you say that something irritates someone else in figures of speech in English? Does it drive you batty or up the wall? Does it run or drive you crazy? Does this sentence make or drive you bonkers? Maybe this whole idea is making you nuts enough to concede that figures of speech can frustrate an English learner.
The next time you encounter an English language learner, remember that she is most likely doing her best to get a handle on this difficult language. It is not easy in any case to learn another language. To learn English is not a feat for the weak. Encourage the English student in any way you can, perhaps offering to have conversations once a week together so that the student can get English practice from a native English speaker.