Instance-based learning methods like the nearest neighbour classifier have been proven to perform well in pattern classification on many fields. Despite their high classification accuracy, they suffer from high storage requirement, computational cost and sensitivity to noise. In this paper, we present a data reduction method for classification techniques based on entropy-based partitioning and center instances. Experimental results show that the new algorithms achieve a high data reduction rate as well as classification accuracy.