Wanted to share Antfly which I think serves a similar niche:

https://antfly.io/

https://github.com/antflydb/antfly

They’ve put a lot of effort into optimizing the local llm pipelines and I have a lot of faith in the devs working on it.