Branch duct intraductal papillary mucinous neoplasms of the pancreas (BD-IPMN) without malignant features rarely developed into invasive cancer. However, invasive cancer is aggressive once an invasive change occurs. We report three cases of invasive cancers which developed in patients with BD-IPMN and they showed grave clinical courses. All patients were diagnosed with BD-IPMN < 3 cm without malignant features on imaging. Invasive cancer was detected at 2.5 years, 3.0 years, and 4.0 years after BD-IPMN detection in each patient. The intervals of invasive cancer and the last follow-up were 9 months, 3 years, and 1.5 years in the three patients, respectively. All patients were diagnosed with locally advanced pancreas invasive cancers and were treated with palliative chemotherapy or conservative management. The patients died at 3 months, 9 months, and 10 months after the diagnosis of invasive cancers, respectively. We report three cases of invasive cancer developed in BD-IPMN patients and followed fatal courses.