Annotate anything — text, agents, and beyond
Potato is the first annotation platform purpose-built for evaluating AI agents. Import traces from any framework, visualize agent actions interactively, and evaluate with research-grade annotation schemas — all via YAML configuration.
Everything you need for annotation
Powerful features designed for researchers and teams.
20+ Annotation Types
Radio, multiselect, likert, span, text, number, slider, select, multirate, pairwise, triage, event, coreference, image, audio, video annotations and more.
AI-Powered
LLM integration with OpenAI, Claude, Gemini for intelligent hints, keyword highlighting, label suggestions, MACE competence estimation, option highlighting, and diversity ordering.
Multimedia Support
Annotate audio with waveforms, images with bounding boxes and polygons, and video with playback controls.
Active Learning
Uncertainty-based sampling prioritizes annotation on the most valuable examples, maximizing efficiency.
Zero Code Setup
Configure everything in YAML. No programming required to create sophisticated annotation interfaces.
Agent Evaluation
Import traces from 12+ agent frameworks, visualize with interactive step-card displays, and evaluate with purpose-built annotation schemas. The first annotation tool built for the agentic era.
Built for every domain
Text, images, audio, or video — Potato has you covered.
Natural Language Processing
Sentiment, NER, classification
Computer Vision
Bounding boxes, polygons
Audio & Speech
Waveforms, transcription
Conversational AI
Dialogue, response eval
Multimodal
Text, image, audio combined
Biomedical & Social Science
Entity linking, survey instruments
Agent Evaluation
Evaluate AI agents with trace viewers, per-turn ratings, and interactive chat annotation.
Get started in 4 steps
From installation to annotation in minutes.
pip install potato-annotation# Install Potato# Create your config.yaml# Configure your taskpotato start config.yaml# Launch the server# Open localhost:8000# Start annotating!Browse 100+ annotation designs
Ready-to-use configurations from the community.
Ready to start annotating?
Join researchers and teams worldwide using Potato.