The 322-apartment tower was to become the tallest building in South Yorkshire, but the city's planning committee decided to turn down the scheme because it was too high and 'of insufficient quality and distinction'.
Backed by developer the City Lofts Group, the tower in Arundel Gate was planned to be the centrepiece of the St Paul's Place development.
Speaking shortly after the committee meeting last week, councillor Tim Rippon, the cabinet member for economic regeneration, culture and planning, said: 'The planning board have strong aspirations for Heart of the City and for the standards in that development.
'The scheme hasn't satisfied them so more work will need to be carried out in order to deliver those high expectations and standards.'
It is understood the architects are meeting the city's planners today to discuss the way forward for the scheme.