PyRIT is Microsoft’s Python Risk Identification Toolkit (MIT) for AI red teaming, favored by security researchers building custom multi-turn attack orchestration. ai-blackteam is independent and ships a large curated attack corpus that runs with one command.

​
At a glance

ai-blackteamPyRIT
LicenseMITMIT
Backed byIndependentMicrosoft
Installpip install ai-blackteampip install pyrit
PhilosophyCurated corpus, run with one commandProgrammable orchestration framework
Curated attacks1,020 ready to runBring/compose your own
Adaptive attacksCrescendo, TAP, PAIR built inCrescendo, TAP, custom orchestrators
Providers17 (16 vendors + generic HTTP)Azure, OpenAI, HF, custom targets
Compliance mapsOWASP LLM + Agentic, MITRE ATLAS, MLCommons, NIST, EU AI ActResearcher-defined scoring

​
When PyRIT fits

  • You are a security researcher who wants full programmatic control to compose novel multi-turn campaigns
  • You want to script bespoke attacker-target-scorer loops
  • You are in the Azure ecosystem

​
When ai-blackteam fits

  • You want a large curated attack corpus that runs out of the box without writing orchestration code
  • You want pip install + ai-blackteam run in under a minute
  • You want compliance-mapped scorecards for audit reporting
  • You want a vendor-neutral tool not tied to a single cloud

​
Summary

PyRIT is a framework you build campaigns with. ai-blackteam is a corpus you run. Many teams use PyRIT for bespoke research and ai-blackteam for fast, repeatable, compliance-mapped coverage.