Strong ground motions at specific sites can cause severe damage to structures. Understanding the influence of site characteristics on the dynamic response of structures is crucial for evaluating their seismic performance and mitigating the potential damage caused by site effects. This study investigates the impact of the average shear wave velocity, as a site characteristic, on the seismic response of low-to-medium-rise reinforced concrete buildings. To explore them, one-dimensional soil column models were generated using shear wave velocity profile from California, and nonlinear site response analyses were performed using bedrock motions. Nonlinear dynamic structural analyses were conducted for reinforced concrete moment-resisting frame models based on the regional information. The effect of shear wave velocity on the structural response and surface ground motions was examined. The results showed that strong ground motions tend to exhibit higher damping on softer soils, reducing their intensity, while on stiffer soils, the ground motion intensity tends to amplify. Consequently, the structural response tended to increase on stiffer soils compared to softer soils.