At afternoon tea overlooking his most famous creation, the architect reflects on icons, idealism and redefining skylines