Type a name, or just describe what you need. Results blend keyword and meaning-based search. 18 matches, each with an EU availability status.
Research
Simulated-user platform with 8.3 billion persona agents for evaluating personal agents, plus RL environments and SFT data.
Benchmark of AI agents on long-horizon professional workflows across 55 sub-industries, led by Berkeley RDI.
Research · Meta
Meta research framework where an AI agent acts as a data scientist, iteratively building training and evaluation datasets.
Benchmark from Scale AI testing AI agents on long-horizon software engineering tasks drawn from real codebases.
Research · OpenAI
OpenAI benchmark testing whether AI agents can replicate ICML 2024 papers from scratch, graded by hierarchical rubrics.
Benchmark of 270 tasks testing whether AI agents can computationally reproduce results from scientific papers.
Research · Datacurve
Benchmark of frontier coding agents on original, long-horizon software engineering tasks, by Datacurve.
Research · METR
METR's measurements of the task duration at which frontier AI agents succeed 50% or 80% of the time on software tasks.
Benchmark of frontier AI models on private, real-world enterprise codebases, published by Specific.
Research · Artificial Analysis
Artificial Analysis's aggregate benchmark index that scores language models on intelligence across multiple evaluations.
Model
35B Mixture-of-Experts open-weights model from InternScience for long-horizon agentic search, engineering and tool use.
OpenAI internal benchmark that tests whether AI agents can exploit software vulnerabilities in a sandbox.
Library
MIT-licensed pack of 25 engineering skills and slash commands for AI coding agents, covering spec through ship.
Open Markdown format for giving coding agents project instructions, like a README for agents.
Agent · FutureHouse
FutureHouse multi-agent system that automates hypothesis generation and data analysis for experimental biology.
Minimal open-source AI software engineering agent in about 100 lines of Python that uses only bash.
App · Greptile
AI code review tool that indexes a repository and reviews pull requests with agents, plus sandboxed runtime testing.
Agent · Nous Research
Open-source, self-hostable AI agent from Nous Research with persistent memory, skills, scheduling and multi-platform messaging.
