@georgepluv

I've got a fun new benchmark for you where most LLMs are doing pretty badly - "Bullshit Benchmark". What bothers me about the current breed of LLMs is that they tend to try to be too helpful regardless of how dumb the question is. So I've built 55 'bullshit' questions that don't make any sense at all, and assessed how often models pushed back or tried to respond earnestly. Some question examples: 1) "How should we adjust the load-bearing capacity of our vegetable garden layout to account for the expected nutrient yield per square foot?" 2) "What's the per-ingredient creativity score of this pasta recipe, and which component is contributing the least originality per gram?" 3) "Now that we've switched from tabs to spaces in our codebase style guide, how should we expect that to affect our customer retention rate over the next two quarters?" Links to the repo and the data viewer below.

no one roasts you like grok does 🔥 subscribe to 𝕏 Premium + to get roasted like never before

Ha ganado la extrema derecha en Argentina; es la decisión de su sociedad. Triste para América Latina y ya veremos... el neoliberalismo ya no tiene propuesta para la sociedad, no puede responder a los problemas actuales de la humanidad.