Ricardo Olmedo

I am a PhD student at the Max Planck Institute for Intelligent Systems, Tuebingen, working with Moritz Hardt and Bernhard Schoelkopf.

My research focuses broadly on language models & benchmarking.

I am currently visiting Stanford University, and have received the 2025/2027 Google PhD Fellowship.


Google Scholar
Twitter
Email

Selected works:

Computational Arbitrage in AI Model Markets, ICML 2026.
Training on the Test Task Confounds Evaluation and Emergence, ICLR 2025 (Oral).
Lawma: The Power of Specialization for Legal Annotation, ICLR 2025 + CS&Law'25.

Blog posts:

mini-coder: small models for research on SWE agents
How to Fix the LMArena? Release All Data