all that matters is that when you tighten the impeller down, it spins freely.
nothing should drag, it should spin smooth.
if it doesn't spin at all, add more washers.
Try it with no washer, tighten it and see if it spins. Then try it with a thin impeller washer. it takes minutes to swap that...