Toulmin was also the Treasurer of a small hospital and dispensary which, in about 1870, Sir George Gilbert Scott designed a building for in a quiet Gothic style on Holywell Hill, close to the Abbey. It was a two storied asymmetric brickwork building in a domestic style, with a gabled front and plate tracery. It had a projecting ground floor bay and in the 1881 census had three patients and a matron. However, it was demolished in the 1930s.