The New Zealand and Australian governments are being accused of going soft on whaling to appease Japanese diplomats.

Sea Shepherd has raised the concerns after the Australian government for a fourth time refused to release video footage of Japanese whaling in the Southern Ocean in 2008.

The government said releasing the footage, captured by an Australian Customs vessel in 2008, would damage Australian's international relations.

But Sea Shepherd managing director Jeff Hansen said most New Zealanders and Australians oppose whaling, and our governments should do the same.

"It's the Australian Antarctic territory. There's New Zealand waters down there and our governments are happy to turn a blind eye to a rich trading partner like Japan."

Mr Hansen said Australia and New Zealand's diplomatic ties with Japan shouldn't stop us taking a position against its whaling programme.

"The footage is being held because of concerns of upsetting Japan. It's protecting the Japanese whalers and not looking after the wishes of the Australian public."