We have analyzed vector magnetograms and Hβ filtergrams of two sunspot groups, one in a growing phase and the other in a decaying phase. In this study, the temporal evolution of their magnetic morphology has been investigated in association with solar activity. The morphological variations of the growing and decaying phase of these sunspots revealed in detail the coalescence of small spots into a large spot and the fragmentation of a large spot into many small spots, respectively. Numerous small flares were detected in the spot group during the decaying phase. This seems to be intimately associated with the shearing motions of many spots with different polarities created by fragmentation of a large sunspot. The magnetic flux and the average shear angle are found to be substantially reduced during the decaying phase, especially in the course of the flarings. This implies that the decaying phase of the sunspot is, to some degree, involved with magnetic field cancellation. The growing spot group has not shown any large activities, but numerous small spots have grown into a typical bipolar sunspot.