Documentation

Everything you need to evaluate, secure, and monitor your AI applications with EvalGuard.

Install the SDK, run your first eval in under 5 minutes.

64 REST endpoints for evals, security, datasets, and more.

14 commands for local evals, scans, and CI/CD pipelines.

Full type-safe client for Node.js and browser environments.

Pythonic client with async support for ML workflows.

87 built-in scorers for text, semantic, RAG, safety, and more.

168 red team plugins across 44 attack strategies.

83+ LLM providers including OpenAI, Anthropic, Gemini, and more.

Slack, Jira, GitHub Actions, LangChain, and 20+ more.

Docker Compose, Kubernetes, and Helm deployment guides.

EU AI Act, ISO 42001, NIST AI RMF, and MITRE ATLAS mapping.

Quick Start

Get running with EvalGuard in three commands.

npm install evalguard
npm install -g @evalguard/cli
evalguard login --key eg_your_api_key