The numbers and how they are accepted by society as a whole does matter. There is sizable minority in the country that is outspokenly ant-Muslim but even inside that minority only a small fraction of them support violence. The same can be said about the Klan. Being a Southern white man I have met and know more than a few people I consider racist, some rather strong racist, but I do not know anyone who would not shun and openly condemn groups like the Klan or the use of violence against minorities.
In general I don’t see the same thing the Islamist societies. Yes a there are large numbers who condemn violence but it is accepted enough that people wear Bin Laden tee shirts in the street and politicians openly support it. Whn is the last time you saw someone walking down the street wearing a Klan shirt?

There is virtually no support for religious based wars amongst the modern Christian nations and majority support in most of them for the equal treatment of all religions. Can you make the same claim for the majority of Islamist nations? As an agnostic I take strong issue with anyone who wants to make their religion into law and to punish those who are not pious enough. That is a problem I have with some repubicans. It isn’t just the relatively strong support of violence that scare me it is the large support for making it a crime to commit blasphemy that worries me the most. I have seen more than a few “moderate” Muslims express the belief the burning the Koran should be a crime.

I don't blame their relgion so much as their culture but I do have an issue with their culture.