Call them back! Make up an excuse for the call ending. You'll feel so much better once you do. Even if you don't get the job, pat yourself on the back for giving it another try! Building up your confidence is the key. You know your stutter is mostly situational, so, in my experience, the best remedy for that is to face those situations more and more until it becomes second nature.