Privacy & Security with self-hosted LLMs! You have dreamed of this too?
Today you you can self-host some models, yet this does not mean you can safely browse the web with it, and automate tasks that would interact with your email account, your bank account and your clients.
This is the reason why I left Mozilla, to work full-time on fixing these problems.
Prompt-injection, hallucinations and private information leakage might not be fixable, but they can be identified 100% of the time, deterministically, before any undesirable consequences.
To identify potential issues with your self-hosted LLMs, consider using The Shield. It allows you to see what your LLMs are sending out and seal your AI models, ensuring a safer browsing experience. https://lightinthedarksolutions.com/shield.html
However, asking people to pay first without an established brand nor the ability to audit the code requires a lot of trust.
Without any additional judgement about the product, I would never recommend anybody to do that by fear of spyware, phishing or worse …
From the same consideration, I intend to open source my solutions. At the very least offer auditing capabilities to people like me, who are too paranoiac about security and privacy.
On the topic, I do not want to ask the user to always vouch for every usage. My goal is to detect ahead of executing any command, and offer options to re-try automatically, strip the leaking context, abstract the information or accept it. Only asking the user when there is a doubt, while not bothering the user when there is no issue.
Today you you can self-host some models, yet this does not mean you can safely browse the web with it, and automate tasks that would interact with your email account, your bank account and your clients.
This is the reason why I left Mozilla, to work full-time on fixing these problems.
Prompt-injection, hallucinations and private information leakage might not be fixable, but they can be identified 100% of the time, deterministically, before any undesirable consequences.
https://cogilibre.com/