Go for whichever job you prefer. It's your choice and your life. There is absolutely no reason you should throw it all away because of your stutter. It isn't your problem.