This study started with the issue that the criteria for the general image scale used in outdoor color planning are vague and the vocabulary and expressive area of the scale are not accurate. As an exterior color planning guideline, it is required to suggest a sensible image scale, which is an appropriate assessment tool for outdoor environment. We identified psychological attributes of colors and set the color image scale axis as “Soft–Hard” in a vertical and “Warm–Cool” in a horizontal. 26 sensibility languages were finally selected for the image scale through literature review, pre-analysis, and expert evaluation. All types of colors extracted from analyzing over 600 photo images were categorized according to 26 sensibility languages. 3 colors by each sensibility language were finally selected and arranged in the color image scale in accord with the outdoor environment of the apartment houses. The significance of this study is that wide range of color position in the color image scale could be utilized as an effective guideline for actual color planning by upgrading the existing color image scale to a higher level with the color reflecting sensibility language. The result also implies that the development of diversified color palette is required especially for the exterior color planning of apartment houses, and the systematical color design process should be established in order to improve the quality of color environment.