I hardly type at all now. I use Handy (free) with Parakeet and use its post-LLM processing feature with a custom prompt tailored towards coding, so I can say things like "Have it go to slash remote dash control" and it'll output "/remote-control". Converts brackets, etc.
Everything is almost instant, it's insanely fast, and lets me work on multiple different agents/windows at the same time fast with cmux.
I use the same thing to talk to people on Slack, iMessage, etc now when I'm working from home instead of typing.
I also can help articulate my thoughts better when I'm thinking them literally out loud instead of just sitting silent and typing them on a computer for hours.
It's just something that you need to try and get used to because I also thought it was something I wouldn't like at first.
Can you share more information on the post-LLM processing and the prompt you use? I would like to try this out but don't see any post-LLM options in Handy.
edit: nevermind, found info on the docs about how to enable post processing. Would still be interested in your prompt though if you don't mind sharing!
It's almost instant on my new M5 Max w/ 36GB of memory, but I used both with Handy on my previous 2019 Intel Mac w/ 16GB memory and was completely surprised at just how fast it was for being on-device! Not instant, but only a couple seconds.
I’m using it on an M3 max 32gb, and I’m getting 60-70x realtime for recordings and crazy good accuracy. I can get an hour of audio transcribed in a minute. Similar results from Whisper, but half the speed.
Transcription this good used to cost A LOT, now it rounds down to free.
Everything is almost instant, it's insanely fast, and lets me work on multiple different agents/windows at the same time fast with cmux.
I use the same thing to talk to people on Slack, iMessage, etc now when I'm working from home instead of typing.
I also can help articulate my thoughts better when I'm thinking them literally out loud instead of just sitting silent and typing them on a computer for hours.
It's just something that you need to try and get used to because I also thought it was something I wouldn't like at first.