Hacker Timesnew | past | comments | ask | show | jobs | submitlogin

Or create "blind" benchmarks.

10 groups of 3 researchers, all have their own benchmarks that they do not share (testing it without the authors knowing is a different problem, maybe they only run the benchmarks when the gen-pop has access to the models).

that's 10 different tests. Aggregate pass rates



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: