This work addresses the development of the astronomical observatory all through history, from an architectural point of view, as a building in relation to the observing instruments and their functioning as a heterogeneous work center. We focused on 32 observatories (in the period 1259–2007) and carefully analyzed the architectures. Considering the impact of the construction itself or its facilities on the results of the research (thermal or structural stability, poor weather protection, turbulence, etc.), there is little attention paid to theories or studies of the architectural or construction aspects of the observatories. Therefore, this work aims to present a theoretical-critical contribution that, at least, invites the reflection of those involved in the development of astronomical observatories in the future.