Comes down to this, either you find a fit in a fraternity or you don't. Stutter aside, that's true for any guy rushing. Don't force it, and if brothers from one are giving you shit over it, they obviously aren't going to welcome you so move on. I rushed a fraternity and never once was my stutter an issue. Was it brought up? Definitely, but no more than any other attribute of the other pledges.