Skip to content

pytest-llm-report Documentation

Welcome to pytest-llm-report, a pytest plugin for generating human-friendly test reports with optional LLM annotations.

Live Test Report Available

View the latest test report for this project:

🧪 Interactive Test Report 📄 Test Report Docs

Looking for more context? See the Test Report page for a live embed and a static example report.

Quick Start

Install the plugin: 

pip install pytest-llm-report

Run tests with a report: 

pytest --cov=my_pkg --cov-context=test --llm-report=report.html

Features

  • HTML and JSON reports with per-test coverage
  • LLM annotations describing what each test verifies
  • Local or cloud LLM support (Ollama, OpenAI, Anthropic, Gemini)
  • Privacy-first - LLM is disabled by default
  • CI/CD ready - artifacts for pipelines
  • Aggregation - Combine reports from multiple runs (see Aggregation)

Documentation