Both religions say I should be killed for "sorcery" I think being afraid of the followers of a religion that threatens you is Just.
It seems almost ridiculous to ask if it is "just" to be afraid of that which history and current world affairs, confirm to be deadly. Although Islam is the most dangerous, openly intent and horrific threat to ALL of humanity, history has shown that the fervor of man made religions*, is deadly (*which is every single one, as God has no religion).
Why be scared of someone just because of their religion or anything that doesn't have to do with their personality? That's just stupid!