To explore the relationship of species diversity and aboveground productivity in grazing ecosystem is very important to manage grassland. We used the four years' data to check this relationship and to look how abiotic factor affect species diversity and aboveground productivity. We found a good linear relationship between species diversity and aboveground productivity in all previous grazing sites, while no any relationship was found in the no grazing site. From our results, we concluded that drought affects aboveground productivity more than grazing, while heavy grazing affects species diversity more than drought in Inner Mongolian steppe.