The Sunday Times has pointed out striking similarities between Speer's Beijing Axis scheme and a boulevard designed by his father for pre-war Berlin.
'Often abroad, especially in England, this comparison is made. Albert Speer Jr is not happy about this,' said an AS&P spokesman.
AS&P was appointed by the Chinese government in 2003 as lead architect, with a brief to transform Beijing into a 'modern megacity' using 'traditional Chinese city planning'.
Running through the heart of Speer Jr's masterplan is an 8km boulevard stretching from a new central rail terminus past Tiananmen Square and the Forbidden City to the Olympic park.
The design was compared to Hitler's unfulfilled vision for the capital of the Third Reich, which included a 5km axis sweeping past ostentatious rail stations and municipal buildings.
The AS&P spokesman said: 'Beijing is not only AS&P's design, it is a mixture of all the competition entries. You cannot work out if it is more AS&P or another practice.'
The spokesman added that Speer Jr is rarely compared with his father because the two did not have any 'real' contact.
He added: 'Speer Jr started work as an architect after his father had stopped working. It is unusual for people in Germany to compare them.'