Self-piercing riveting(SPR) is a sheet joining method that can be used for materials which are difficult or unsuitable to weld, such as aluminum alloy and different steel sheet metals. No pre-drilled hole is needed for SPR; the rivets are pushed directly into the sheets clamped together between a blank holder and a die in a press tool. In this paper, self-piercing rivet and anvil were designed for four joining conditions with dissimilar sheet metals. SPR was simulated by using commercial FEM code DEFORM-2D. In simulation of SPR process, various strengths of self-piercing rivet were considered. The mechanical properties could be determined by tensile test for quenched rivets and sheet metals. The designs of rivet and anvil were modified by comparisons of simulated results.