Annotate anything — text, agents, and beyond
Potato is the first annotation platform purpose-built for evaluating AI agents. Import traces from any framework, visualize agent actions interactively, and evaluate with research-grade annotation schemas — all via YAML configuration.
pip install potato-annotation# Install Potato# Create your config.yaml# Configure your taskpotato start config.yaml# Launch the server# Open localhost:8000# Start annotating!Everything you need for annotation
Powerful features designed for researchers and teams.
Agent Evaluation
Review web agent traces with filmstrip navigation, watch live agents in real time, consult an LLM chat sidebar during annotation, and export to HuggingFace Hub — all via YAML.
21 Annotation Types
Radio, multiselect, likert, slider, text, span, best-worst scaling, pairwise, number, select, multirate, pure display, video, image, audio, bounding box, polygon, tiered, per-turn dialogue, event, and taxonomy annotation.
AI-Powered
LLM integration with OpenAI, Claude, Gemini for intelligent hints, keyword highlighting, label suggestions, MACE competence estimation, option highlighting, and diversity ordering.
Multimedia Support
Annotate audio with waveforms, images with bounding boxes and polygons, and video with playback controls.
Active Learning
5 query strategies — uncertainty sampling, diversity-based selection, BADGE, BALD, and hybrid ensemble — plus LLM cold-start for intelligent instance selection before any labels exist.
Zero Code Setup
Configure everything in YAML. No programming required to create sophisticated annotation interfaces.
Built for every domain
Text, images, audio, or video — Potato has you covered.
350+
Browse 350+ annotation designs
Ready-to-use configurations from the community.
Ready to start annotating?
Join researchers and teams worldwide using Potato.