Annotate anything — text, agents, and beyond
Potato is the first annotation platform purpose-built for evaluating AI agents. Import traces from any framework, visualize agent actions interactively, and evaluate with research-grade annotation schemas — all via YAML configuration.
pip install potato-annotation# Install Potato# Create your config.yaml# Configure your taskpotato start config.yaml# Launch the server# Open localhost:8000# Start annotating!Everything you need for annotation
Powerful features designed for researchers and teams.
Agent Evaluation
Import traces from 12+ agent frameworks, visualize with interactive step-card displays, and evaluate with purpose-built annotation schemas. The first annotation tool built for the agentic era.
20+ Annotation Types
Radio, multiselect, likert, span, text, number, slider, select, multirate, pairwise, triage, event, coreference, image, audio, video annotations and more.
AI-Powered
LLM integration with OpenAI, Claude, Gemini for intelligent hints, keyword highlighting, label suggestions, MACE competence estimation, option highlighting, and diversity ordering.
Multimedia Support
Annotate audio with waveforms, images with bounding boxes and polygons, and video with playback controls.
Active Learning
Uncertainty-based sampling prioritizes annotation on the most valuable examples, maximizing efficiency.
Zero Code Setup
Configure everything in YAML. No programming required to create sophisticated annotation interfaces.
Built for every domain
Text, images, audio, or video — Potato has you covered.
350+
Browse 350+ annotation designs
Ready-to-use configurations from the community.
Ready to start annotating?
Join researchers and teams worldwide using Potato.