Skip to content

Azure/agentops

AgentOps Accelerator

Evaluate. Ship. Observe. Own.
Continuous evaluation, safety testing, observability, and release readiness for Microsoft Foundry agents.

Documentation | PyPI | VS Code Extension | Latest release

PyPI VS Code Extension CI Release License: MIT

AgentOps Accelerator helps Microsoft Foundry agent teams evaluate quality, prepare releases, monitor behavior, and stay accountable after launch. It gives you a practical starting point for agent operations, with Foundry integration as the default path and deeper setup guidance in the full docs.

Get started

python -m pip install agentops-accelerator
agentops init
agentops eval analyze
agentops eval run
agentops doctor --evidence-pack

What it helps you do

Use AgentOps Accelerator when you need to:

  • Evaluate an agent before release
  • Compare changes across versions
  • Capture release evidence
  • Monitor agent quality and regressions
  • Give teams a repeatable way to own agent behavior in production

The accelerator keeps the local workflow simple, then points you to the full docs when you are ready to configure pipelines, dashboards, and release practices.

Learn more

For setup guides, tutorials, architecture, CI/CD guidance, Doctor checks, and evaluator reference, see:

https://aka.ms/agentops-accelerator

Contributing

See CONTRIBUTING.md for development, testing, and contribution guidance.

About

AgentOps Accelerator is an open source framework and CLI for adding continuous evaluation and observability to enterprise AI agents. It standardizes evaluation patterns, automates assessments in CI/CD workflows, and generates structured signals that help teams monitor, control, and safely operate agentic systems at scale.

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Contributors