ScreenSuite - The most comprehensive evaluation suite for GUI Agents!

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Smol2Operator: Post-Training GUI Agents for Computer Use

Back to The Future: Evaluating AI Agents on Predicting Future Events

A New Framework for Evaluating Voice Agents (EVA)

Announcing Evaluation on the Hub

Natural Language Query to Configuration for Retrieval Agents

Modern retrieval agents expose many configuration choices -- LLM, retriever, number of documents, number of hops, and synthesis strategy -- each shaping both answer quality and serving cost. Today, these pipelines are typically hand-tuned once per workload, leaving substantial per-query optimization untapped. We for...