Yes. awaresie is free to use, with no account and no sign-up.

Do I need an account to use awaresie?

No. There is no sign-up, no email and no password. Open it and it works - your device gets an anonymous identity.

Can I host my own event on awaresie?

Yes. Anyone can create an event in seconds, one-off or repeating, and share it with a link that carries the what, where and when.

Benchmarks Are Lying to You: How to Evaluate Models and Agents in the Real World · Tue, Aug 4

Benchmarks Are Lying to You: How to Evaluate Models and Agents in the Real World

When: Tue, Aug 4
Where: STATION Austin, Voltron Room (1st floor)
Category: community

**Details** **Benchmarks Are Lying to You: How to Tell Whether Models and Agents Actually Work** **Description** AI benchmarks are everywhere, but what do they actually measure, and how much should we trust them? In this talk, we’ll break down the major benchmarks used to evaluate language models, coding systems, multimodal models, and autonomous agents, from MMLU and GPQA to SWE bench, GAIA, and OSWorld. We’ll explore common pitfalls such as benchmark contamination, judge bias, agent scaffolding, hidden test-time compute, and misleading leaderboard comparisons, then discuss how to design pra…

Open this event on awaresie to see it on the map, get directions, RSVP and chat with the other guests - no account needed.

mapsee.me

What

When

Starts Ends

Where

Sharing

Privacy Hosted by

Extras · poster, category, map icon

Category Map icon

Also show under (optional)

Benchmarks Are Lying to You: How to Evaluate Models and Agents in the Real World · Tue, Aug 4 · STATION Austi…

Welcome to mapsee.me 👋