As a renewable nanomaterial, cellulose nanocrystal (CNC) isolated from wood grants excellent mechanical properties in developing high performance nanocomposites. This study was undertaken to compare the reinforcing efficiency of two different CNCs, i.e., cellulose nanowhiskers (CNWs) and cellulose nanofibrils (CNFs) from hardwood bleached kraft pulp (HW-BKP) as reinforcing agent in polyvinyl alcohol (PVA)-based nanocomposite. The CNWs were isolated by sulfuric acid hydrolysis while the CNFs were isolated by 2,2,6,6-tetramethylpiperidine-1-oxyl radical (TEMPO)-mediated oxidation. Based on measurements using transmission electron microscopy, the individual CNWs were about 6.96±0.87 nm wide and 178±55 nm long, while CNFs were 7.07±0.99 nm wide. The incorporation of CNWs and CNFs into the PVA matrix at 5% and 1% levels, respectively, resulted in the maximum tensile strength, indicating different efficiencies of these CNCs in the nanocomposites. Therefore, these results suggest a relationship between the reinforcing potential of CNCs and their physical characteristics, such as their morphology, dimensions, and aspect ratio.