Most of a former Sheffield coffee house described as an important part of the city’s working-class history can be demolished as part of a housing scheme despite calls to save it.