A man in his 60s has died after being swept out to sea while whitebaiting in Wairarapa.

Police announced the death at 3.45, after the man was rescued from the sea south of Lake Ferry around 2.30.

A staff member at the Lake Ferry Hotel, who doesn't want to be named, said a man in the hotel swam out to the whitebaiter after seeing him get swept away.

She said he appeared unconscious, and spent some time in the water before he could be rescued.

She said it took around 20 minutes, and the water is very cold and very rough.

Police say they're working to formally identify the man.