This was built as the Naval Dockyard church in 1857-9 from brick with stone dressings. It was asymmetrical with a turret. It was moved to its present site in 1933, damaged in World War II, and restored and remodelled in neo-Regency style in 1956-7.