Can't handle pauses

I find that if I hold down the shortcut and maybe don't start to talk immediately or maybe pause after starting, it goofs it up and I get gibberish. I also have Wispr Flow and I don't experience anything like that with it, so it seems like something should be able to be done.