A Muslim cleric gave what has been labelled hate speech in an online video has been permanently stood down.

The Federation of Islamic Associations said the action against Shaykh Dr Mohammad Anwar Sahib is effective immediately.

LISTEN ABOVE: Ahmadiyya cleric Shafiq Ur Rehman spoke to Larry Williams yesterday

The Federation said it vehemently opposes all teaches that promote intolerance, prejudice and discrimination.

It said it is aware of complaints being laid with the Human Rights Commission.

The Human Rights Commission earlier said speeches allegedly given by Sahib were appalling and had no place in New Zealand.

"We live in one of the most ethnically diverse nations on earth as well as one of the most peaceful: this is because we are a tolerant nation," said Race Relations Commissioner Dame Susan Devoy in response to a video that emerged online of a Sahib giving what has been labelled an anti-Semitic hate speech.

"This kind of intolerance is not welcome here in any form: Prejudice against Jewish people has no place in New Zealand," Devoy said.

Videos of speeches delivered by Sahib at the Manukau mosque have been widely viewed online.

But he hit back at the criticism yesterday, saying he was taken out of context and preaches for peace and harmony in society.

Sahib was shown in a series of lectures recorded at a Manukau mosque and posted on social media vilifying Jewish and Christian communities.

But in a statement he said he had been misrepresented as a scholar of Islam and his lectures, if watched in their entirety, would show he was simply discussing history.

In a statement to the Herald Sahib said those who had watched the videos would find he had not incited any hatred towards others, nor asked anyone to attack or harm anyone.

"Sadly and falsely, I have been accused of giving hate speeches and being anti-Semitic," he said.

"I wish to make it absolutely clear to those who have watched the video and who have commented that I have given hate speech in regards of people of other faith that I do not hate any human being regardless of their faith, place of origin, race, colour and political affiliation."

The Administration Council of the Islamic Women's Council described Sahib's comments as "totally inappropriate".

"We unequivocally condemn any divisive comments of a similar nature. While we may disagree with aspects of Jewish theology, and may have political disagreements, we see the Jewish people as closely connected to us through the Abrahamic tradition," a spokesperson said.

"The Prophet Muhammad had good relationships with his Jewish neighbours and encouraged Muslims to do the same. We are permitted to eat their kosher food, and we offer them our respect. We regularly extend our hand in friendship to the Jewish community in New Zealand, and will continue to do so.”

Additional reporting by the NZ Herald