Work to demolish former buildings at Pontefract General Infirmary has begun.
The work on buildings behind the former dispensary, off Southgate, is due to be complete within months.
Pontefract Dispensary and Hermitage Action Group (PDHAG) is in talks with Mid Yorkshire Hospitals Trust to transform the dispensary building and create jobs and boost tourism by turning the site into a museum.
Colin White, group chairman, said: “These demolition works were always part of the plan. The scheme was to preserve the dispensary on Southgate but demolish all the other buildings because they don’t have the same importance and heritage as the dispensary.
“The buildings will be demolished, the site will be tidied up and then the workers will sort out the back of the dispensary but none of the dispensary itself will be knocked down.
“It is on Wakefield Council’s list of notable buildings so the council wouldn’t grant permission for that to be demolished.”
Mr Dale said the hermitage - which was used to cultivate liquorice and dates back to the 1300s - was a grade one listed building.