UPDATED 1:21pm: The ballot box has come out at Labour, but it appears the party's just chosen a new whip.

Labour's MPs are locked in a tense caucus meeting, following their devastating election loss at the weekend.

Senior whip Sue Moroney - a staunch supporter of David Cunliffe - told media this morning she'd be stepping aside from the role of wrangling the party's MPs.

"I've had my time in the whip's role and I'm keen to focus on portfolio work."

The MPs are understood to have elected a new senior whip in the past hour.

Mr Cunliffe's told media he wants a vote on his leadership before the end of the year - but that's expected to be weeks off yet, as his potential challengers do the numbers.

The Labour leader says if the wider party backs him after his rejection by his colleagues he'll remain in the job.

Mr Cunliffe has gagged his colleagues but they've already started talking.

He says the voters clearly didn't see Labour as an alternative Government.

"I want to be clear that I as leader am responsible for that result. It was deeply disappointing to our supporters, to my caucus colleagues and to our party. But the voters are always right."

Cosgrove unsure about party direction

Labour MP Clayton Cosgrove is continuing to express his reservations about the direction his party has been taking.

It comes as Labour MPs have met for their first meeting following their election night hiding - already there is open dissent and splits emerging as the party's leadership looks up fro grabs.

Mr Cosgrove isn't happy with the way the party is perceived by the public.

"People feel we're a narrow party, that we represent narrow interests, that we get tied up in too much peripheral stuff. If we as a political movement don't change and evolve with those people, then we have some difficulties. We fall out of touch with them."