To really tease out differences you will probably need a bit more data. Check out this github repository. There is also a research paper describing the data used. https://github.com/apple/ml-stuttering-events-dataset