Just something to ponder,
.....back in the day I never used filler. When the surface was at or close to applying finish I would cut TruOil 1/3 with mineral sprits, apply wet and sand it into the wood with 320/ 400 until it was thick. Do the whole stock and let it dry, re-sand, clean and check...