Can I put a non polarized capacitor in place of an electrolytic (one that has plus and minus signs)?
Yes you can. It’s more troublesome to do the other way – to put an electrolytic in place of a normal capacitor since you have to orient the capacitor the correct way or bad things could happen. Don’t do this on high power circuits though. For most 9V stompboxes, this should be fine. How do you know which way to orient the polarized cap? The side with the larger voltage faces the positive side of the cap.