If you really enjoy being a librarian then go for it at the end of the day stutter can only get better, live your own life you want to live do not let a small thing stop you, I have anxiety about speech too, but at least I/you can speak at all, compared to mute people so do not fear :)