Designed by Bennetts Associates and Lomax Cassidy & Edwards, the building had been touted by bookmakers William Hill as one of two frontrunners - alongside Foster and Partner's McLaren Technology centre - in with a shout for the £20,000 top prize.
However, according to a survey on the BBC's website, only 11 per cent of the 12,500 voters plumped for the scheme, leaving the PFI-funded library trailing in fourth place.
The other surprise is the popularity of RMJM and Enric Miralles's controversial Scottish Parliament at Holyrood, Edinburgh. The £431 million building was given the nod by 21 per cent of internet voters, making it the current second favourite in the poll.
But if early indications are anything to go by, Foster's McLaren scheme in Woking looks set to give the international star his second Stirling victory in as many years.
The McLaren centre has amassed more than a third of the vote - justifying the bookmaker's odds of 5/2.
Meanwhile, O'Donnell and Tuomey's Lewis Glucksman Gallery in Cork, seen by many as a solid outside bet, came third in the survey with 15.5 per cent of the vote.
At the bottom of the rankings, Zaha Hadid Architects' BMW Central Building in Leipzig managed to land only 9 per cent and Will Alsop's Fawood Children's centre a lowly 8 per cent.
The winner of this year's prize, which is being sponsored by The Architects' Journal, will be announced at a ceremony in Edinburgh on 15 October.