If those who have gone astray will not harm the guided (Qur'an 5:105), why were many Prophets harmed?

Question

O you who have believed, upon you is [responsibility for] yourselves. Those who have gone astray will not harm you when you have been guided. To Allah is your return all together; then He will inform you of what you used to do. -- Qur'an 5:105

I feel I'm misunderstanding the sentence in bold. Several Islamic Prophets seem to have been harmed by those who have gone astray; as a few examples:

• Prophet Yusuf was thrown down a well, was sold as a slave, and was imprisoned for many years.

• Prophet Nuh's and Prophet Lut's wives "...were under two of Our righteous servants but betrayed them" (Qur'an 66:10).

• Prophet Yunus was thrown off a ship, to be consumed by a fish (Qur'an 37:142).

Presumably, it's safe to consider that these Prophets were guided, yet harm came to them.

Question: If those who have gone astray will not harm the guided, why were many Prophets harmed?

Answer 1

Here I think God doesn't speak about the physical harm, instead Allah is referring to a harm of your faith. He is saying that your faith is your responsibility and yours only. The disbelievers will not harm your faith. This is only from the context of the sentence, if you read it in arabic, as there is no punctuation in arabic, so the whole verse should be taken as is. And also when he says "harm you" it's followed by " when you have been guided" so you see that the harm is more to your guidance. The word here translated as harm, can also mean to damage.

you can read more explanation and alternative translation here : http://www.alim.org/library/quran/AlQuran-tafsir/MDD/5/105
and here the definition of the verb translated as harm : https://en.wiktionary.org/wiki/%D8%B6%D8%B1

my last comment, is even if you see translations in English using punctuation please remember that doesn't exist in Arabic so try to understand a whole verse as one sentence.