A 99-year-old Royal Navy veteran said he was thinking on Remembrance Sunday of the men on his ship who “never came home”.