The purpose of this study was to evaluate the effects of different Hydraulic Retention Times (HRTs) on the contaminant removal efficiency using Aerobic Granular Sludge (AGS). A laboratory-scale experiment was performed using a sequencing batch reactor, and the Chemical Oxygen Demand (COD), nitrogen, orthophosphate removal efficiency, AGS/MLSS ratio, and precipitability in accordance with the HRT were evaluated. As a result, the COD removal efficiency was not significantly different with the reduction in HRT, and at a HRT of 6 h, the removal rate was slightly increased owing to the increase in organic loading rate. The nitrogen removal efficiency was improved by injection of influent division at a HRT of 6 h. As the HRT decreased, the MLSS and AGS tended to increase, and the sludge volume index finally decreased to 50 mL/g. In addition, the size of the AGS gradually increased to about 1.0 mm. Therefore, the control of HRT provides favorable conditions for the stable formation of AGS, and is expected to improve the contaminant removal efficiency with the selection of a proper operation strategy.