Winston Peters has launched a scathing criticism of his own government's decision to stay on Alert Level Two.
Jacinda Ardern says it could be another month before we move to Alert Level One.
But her deputy says we should be at Level One now, and we should already have opened our borders to Australia through a trans-Tasman bubble.
Police Minister Stuart Nash has also admitted there has been disagreement in cabinet.
"We have agreed to disagree respectfully, because the one thing we don't want to do is move backwards," he told Newstalk ZB's Mike Hosking.
"We are leading the world in opening up our country and our economy. We're leading the world."
Nash says while America's death toll will reach 100,000 later today, New Zealand's economy will soon be one of the most open in the world.
"We'd rather take a conservative approach and get this right, because the last thing we want to do move back into Level 3, or -- heaven forbid -- Level 4.
"We're taking a prudent approach."