Skills

LLM Evaluation Design

Creates offline and online evals for quality and safety.

Error Analysis

Uses traces to identify failure clusters and root causes.

RAG Systems

Builds retrieval pipelines with observability and guardrails.

Model Serving

Deploys low-latency endpoints with fallback strategies.

Telemetry

Instruments LLM workflows for debugging and monitoring.

Synthetic Data

Generates focused test sets for edge cases and regressions.