In this study, the anti-inflammatory activities of the extracts of different parts of Hovenia dulcis such as leaves, stems, and roots were investigated. Among them, the roots extract (RE) showed the most potent suppressive effect against pro-inflammatory mediators in LPS-stimulated mouse macrophage cells. RE induced dose-dependent reduction of inducible nitric oxide synthase (iNOS) and cyclooxygenase-2 (COX-2) and concomitantly reduced the production of NO and PGE2. Additionally, pre-treatment with RE significantly suppressed the production of inflammatory cytokines, such as tumor necrosis factor-α (TNF-α), interleukin (IL)-1β, and IL-6, as well as mRNA levels. Moreover, phosphorylation of mitogen-activated protein kinases (MAPKs) and nuclear translocation of nuclear factor-kappa B (NF-kB) were also strongly attenuated by RE in RAW264.7 cell. Furthermore, RE induced HO-1 expression through nuclear translocation of nuclear factor E2-related factor 2 (Nrf2) and increase HO-1 activity in RAW264.7 macrophages. Therefore, these results indicate that RE strongly inhibits LPS-induced inflammatory responses by blocking NF-kB activation, inhibiting MAPKs phosphorylation, and enhancing HO-1 expression in macrophages, suggesting that RE of H. dulicis and a major component, 27-O-protocatechuoylbetulinic acid could be applied as a valuable natural anti-inflammatory material.