Show HN: Humor Arena – Which frontier model is funniest?
4 by killiandunne1 | 4 comments on Hacker News.
What if you could measure humor? Well we've trained a model on our own dataset of ~50k human ratings to detect what jokes people find funniest.
We know it's part objective, part subjective component.
Subjective is out of our depth for now haha The main results: Fable 5 is funniest - beating the average model 67% of the time, with GPT 4o last at 17%. Other findings:
- The models never refused to try, even with dark prompts
- Thinking longer has a slight benefit
- Absurdness correlates negatively with joke quality Some methodology notes:
- We benchmarked our model against the human majority and it agreed 72% of the time in a blind sample test.
- We had 51 US adults rate the jokes, each blind to the models, with joke order randomized, and quality checked for attention and speed.
- To rate some yourself visit https://pair.laugh.so The full benchmark here: https://ift.tt/qfS9nEQ Am taking requests if there's more research you want to see! Cheers