You can get the shaft out without removing the impeller, I have one sitting on my bench that way that I couldn't get the impeller off of... HOWEVER, I had no regard for the hull or ever putting it back together. Be careful with the "screwdriver through the hole in the shaft" method. I used an allen wrench and actually put enough force on the impeller to have the allen wrench cut a big slot in the hull...
If you can't get it off, I think you can pull the motor and start disassembling the driveshaft holder on the inside of the ski. You'll have to be creative but you can pull the bearings (along with the housing) off the shaft and then you can slide the shaft out the back of the ski.