This study involved the heterogenization of a binder pitch (BP) using a small amount of nanocarbon to improve physical properties of the resulting graphite electrode (GE). Heterogenization was carried out by adding 0.5–2.0 wt.% platelet carbon nanofiber (PCNF) or carbon black (CB) to a commercial BP. To evaluate the physical properties of the BPs, we designed a new model graphite electrode (MGE) using needle coke as a filler. The heterogenized binder pitch (HBP) with PCNF or CB clearly increased the coking value by 5–13 wt.% compared to that of the as-received BP. Especially, the model graphite electrodes prepared with HBPs containing 1.0 wt.% PCNF or CB showed significantly improved physical properties compared to the control MGE from the as-received BP. Although the model graphite electrodes prepared with HBPs showed similar properties, they had smaller pore sizes than the control. This indicates that heterogenization of the BP can effectively decrease the pore size in the MGE matrix. Correlating the average pore sizes with the physical properties of the model graphite electrodes showed that, for the same porosity, matrices formed by the HBP with a smaller average pore size can effectively improve the apparent density, tensile strength, and oxidation resistance of the model graphite electrodes.