Annotate anything with Potato: text, media, and agents
Potato is an open-source platform for annotating text, audio, images, and qualitative data, from classification and span labeling to codebook-driven coding. It also has the broadest agent annotation support of any tool we found: bring traces from any framework, label a multi-agent run on its interaction graph, and set the whole thing up in YAML.
pip install potato-annotation# Create your config.yamlpotato start config.yaml# Open localhost:8000What's in Potato
Built for researchers and annotation teams.
Agent Evaluation
Annotate multi-agent teams on a clickable interaction graph, evaluate computer-use, voice, and video agents, calibrate LLM judges against human labels, edit trajectories into SFT and DPO training data, and rank models in an arena, all from YAML.
61 Annotation Types
Radio, multiselect, likert, slider, text, span, best-worst scaling, pairwise, number, multirate, video, image, audio, bounding box, polygon, event, and taxonomy annotation, plus qualitative coding (QDA Mode) with a living codebook, in-vivo codes, memos, and cases.
AI-Powered
LLM integration with OpenAI, Claude, and Gemini for hints, keyword highlighting, label suggestions, MACE competence estimation, option highlighting, and diversity ordering.
Multimedia Support
Annotate audio with waveforms, images with bounding boxes and polygons, and video with playback controls.
Active Learning
Five query strategies (uncertainty sampling, diversity-based selection, BADGE, BALD, and hybrid ensemble), plus an LLM cold start that picks the first instances before any labels exist.
Zero Code Setup
Configure everything in YAML. Building an annotation interface takes no programming.
Built for every domain
Text, images, audio, and video, in one tool.
Guides to annotation practice
Explainers that answer a question about annotation without assuming a tool, then use Potato as the worked example.
Browse all guides450+
Browse annotation designs
Ready-to-use configurations from the community.
Ready to start annotating?
Potato is free and open source. Install it with pip and run your first task locally.