It's ok, it's not the best. There are models that do better, I'd use it for some basic tasks but not actual complex tasks like query generation and retrieval.
This is going to be a fun one to play with. I've been conducting tests on various models for my agentic workflow.
I was just wishing they would make a new flash-lite model, these things are so fast. Unfortunately 2.5-flash and therefore 2.5-flash-lite failed some of my agentic workflows.
If 3.1-flash-lite can do the job, this solves basically all latency issues for agentic workflows.
I publish my benchmarks here in case anyone is interested:
I never thought of Elasticsearch as a database and always designed systems around what elasticsearch is supposed to be an index based document store for used with search.
I think their API is great and have had amazing results with it. Their recent innovations around quantization (bbq) has been amazing for my use case building an agentic movie database for discovering movies and personalized movie recommendations.
There are benefits to not using your database for everything, even if it adds a bit of complexity by introducing another dependency. If the benefits out weigh the cost of complexity reaching for elastic has almost always been worth it for me.
I see comments like "is this a request to bypass sanctions" OR "he's iranian"
Let's remind ourselves of the following:
- First understand that he didn't choose to be born and raised in Iran.
- Second people grow up have families become attached to where they're born it's not easy to just 'pick up and leave' moving to a new country is expensive and extremely difficult especially from countries like Iran.
- Third he's building something he believes in which is probably better than most people who live in privileged countries who sit around and do nothing.
To me this reads like a plea for help.
He's built something and showing it to the world, if someone likes it and wants to fund him / get him out of Iran, so he can pursue his dreams AND have the people who help him benefit along with him. I'm sure he'll be all for that.
Letting that empathy lead you into violating international sanctions to funnel money to a sanctioned country is decidedly not a good idea.
Requesting that other people sign up for Stripe accounts and send you the money in violation of sanctions is bad. The other person risks extreme legal consequences including prison sentences for deliberately and openly violating sanctions.
The comments are a warning to anyone who might feel compelled to do what is being asked, without realizing the specific request is a serious legal matter that can come with prison terms measured in decades.
> I see comments like "is this a request to bypass sanctions"
Did you read the Gist he posted? It was a direct request for someone to help him bypass sanctions.
Immigrating to a new country isn't something you do on a whim. It takes a very long time (years) and it's not really cheap. It's not a solution to the OP's problem.
The OP wasn't asking for help leaving their country. They were making a specific ask to violate sanctions.
https://upmaru.com/llm-tests/simple-tama-agentic-workflow-q1...