The man stood down from Parliament could have a case to take in court, if he believes he's been wronged by the Speaker.

He was sent home in the wake of the Francis report into bullying, but strongly rejects the implication he's the serial rapist the Speaker suggested was roaming the corridors of power.

Barrister Chris Patterson told Kate Hawkesby if that's the case, he could take Trevor Mallard to court for defamation.

"Saying that someone is a rapist is probably about as bad as you can almost get in terms of damaging someone's reputation."