Overloaded and improperly loaded trucks cause serious road hazards, such as rollovers and cargo falls. Although automatic enforcement methods are being studied, they face challenges in accuracy and legal application. Thus, a technology for direct tracking and enforcement is needed. This study uses EfficientNet to extract features of vehicles and license plates, and applies cosine similarity to identify the same vehicle. Comparisons were divided into “same vehicle” and “similar vehicle,” with a threshold-based method and five classification types. Results showed that the average similarity of the same vehicle group was 0.11 higher than that of the similar vehicle group. The accuracy of correctly identifying the same vehicle was 84.54%. Integrating OCR or LPR is expected to further improve tracking performance.