Veterinary drugs can remain as residues in animal-derived food products, and therefore, many countries conduct residue monitoring programs for imported livestock products. However, because the types and authorizations of veterinary drugs vary among countries, it is necessary for importing nations to establish residue monitoring systems tailored to their specific circumstances. This study aimed to develop an algorithm to quantitatively evaluate and score the risk of veterinary drug residues that may be present in imported livestock products, thereby enabling risk-based prioritization. The overall risk score was calculated as the product of exposure and toxicity factors. To minimize uncertainty, the algorithm utilized objective and accessible data obtained from both domestic and international sources. The exposure factor was determined using the number of residue violations and the estimated exposure value, which was calculated based on withdrawal periods and maximum residue limits (MRLs). The toxicity factor was evaluated using the acceptable daily intake (ADI) and the regulatory importance of the substances. The regulatory importance was classified according to the antimicrobial resistance (AMR) ranking criteria of the World Health Organization (WHO) and the World Organisation for Animal Health (WOAH), while substances not covered by these classifications were ranked based on their impact on the human intestinal microbiota. According to the results of residue violation grading by country and substance, when focusing on meat (excluding dairy products), the United States had the highest number of Grade 5 substances (seven), followed by Canada, Brazil, Mexico, Spain, Uruguay, and Chile, which each contained Grade 5 substances. In domestic livestock products, 14 substances—including cefazolin and amoxicillin—were classified as Grade 5 in beef, eight substances—including amoxicillin and cefquinome—as Grade 5 in pork, and bifenthrin as a Grade 5 substance in poultry. Based on MRL grading, phenylbutazone, norgestomet, and flumethasone were classified as Grade 5 in beef; phenylbutazone, altrenogest, and flumethasone in pork; and phenylbutazone and dexamethasone in poultry. For ADI-based grading, oleandomycin, cefadroxil, avilamycin, norgestomet, and dexamethasone were identified as Grade 5 substances. Withdrawal period grading indicated that gentamicin was categorized as Grade 5 across all livestock types, including cattle, swine, poultry, and milk. In terms of regulatory importance, danofloxacin, ceftiofur, spiramycin, erythromycin, and enrofloxacin were classified as Grade 5 substances. The risk-prioritization algorithm developed in this study identified five substances—ampicillin, closantel, phenylbutazone, ractopamine, and zeranol—as having the highest possible risk score (25 points) in imported beef. This algorithm enables risk-based prioritization using the results of national residue monitoring programs conducted by exporting countries, thereby allowing importers to establish inspection priorities tailored to their own contexts. Consequently, the developed algorithm can be effectively utilized to identify high-risk veterinary drugs by exporting country and livestock type, supporting the establishment of more efficient monitoring plans for imported livestock products.