Either you run it fully locally, or you accept that whoever runs it has access to your thoughts and interests.

Whether you go with microsoft, google, meta, or whatever apple will come up with, it feels like a case of "stay out, or make a pick and stick to it".

I know some have different feelings regarding this or that company that is "better" or "worse", but the reality of it is they're not, and even if they were you don't know where they will be in ten years, and they will still have your data then.

I think Apple may do interesting things here with their rumored focus in purely on-device LLM functionality across the OS, taking advantage of all the hardware work they've put into efficiency and 'Neural Engine' cores. This year's WWDC may be quite interesting.

I am interested to see how Apple's insistence on privacy will square with their GenAI products. If they don't collect feedback and usage data how will they use RLHF to make their suit better ? I understand that have been cutting deals with few publication companies, but will that suffice?

Yeah, I really hope open sources catches up quickly. Why on earth would I want to create a Google account just to use this, especially in work settings?

I think it is only a matter of time before open source vision LLMs have the ability to process videos. The tricky part might be getting to 1M token context length, which even proprietary LLMs (other than Gemini) are struggling with.