That all depends on if your motors reaching it's recommended WOT rpm with the 23" pitch prop? If it's not, then No, the 4 blade 24" pitch won't work, it will only make your motor work harder, (lug) till it blows!
First when adding a prop blade you need to drop back in pitch, then if you are going from aluminum to stainless steel, you need to drop back in pitch again, that equals 2 changes of pitch back, to get approx. the same rpm as the prop you have now.