Blacksmith-AI Explained: How AI Agents Split Up a Pentester’s Job
BlacksmithAI Explained: When AI Agents Split Up to Do a Pentester’s Job
An open-source project splits an entire security assessment — reconnaissance through exploitation — across six coordinated AI agents instead of one generalist model trying to do it all. Here’s what it actually does, why it’s built that way, and who genuinely benefits from it existing.
Editorial Transparency: This article is independently written and not sponsored by BlacksmithAI, Kahan Labs, or its creator. Facts are verified directly against the project’s public GitHub repository and documentation, and against Help Net Security’s reporting, which included direct comment from the creator — all accessed directly. Wangdoo has no commercial relationship with any party named in this piece.
I have not run BlacksmithAI myself. This explains what the project’s own documentation and existing reporting describe, not a hands-on account of using it.
On March 2, 2026, a developer named Yohannes Gebrekirstos released an open-source framework called BlacksmithAI: a system that lets AI agents run a full penetration test on their own, the kind of structured security assessment that normally takes a trained human, or a small team of them, working through several distinct phases in sequence. Help Net Security covered the launch with direct comment from the creator; a handful of security-trade outlets and dev-community blogs picked it up afterward. All of that coverage is aimed at security professionals. This explains the same thing for anyone who isn’t one.
What It Actually Is
BlacksmithAI is a hierarchical multi-agent system, according to its own documentation. One orchestrator agent manages the overall plan and delegates work to five specialised subagents: a reconnaissance agent that maps a target’s attack surface, a scanning and enumeration agent that probes discovered services in detail, a vulnerability analysis agent that maps findings to known weaknesses and prioritises them by risk, an exploitation agent that attempts controlled proof-of-concept exploits, and a post-exploitation agent that assesses what damage a successful breach would actually cause. The orchestrator compiles all of it into a final report with findings, severity ratings, evidence, and remediation guidance.
Each agent works inside a shared container called “mini-Kali” — a pre-configured environment loaded with the tools that agent needs, rather than spinning up a fresh container for every task. According to the creator, this was a deliberate efficiency choice: agents share one environment with tool caching and access controls that stop them from adding or removing tools mid-run, keeping results consistent between attempts.
The agents’ reasoning runs on a large language model, which can be a cloud provider like OpenRouter or a model hosted locally through vLLM, so the project doesn’t lock anyone into one AI vendor. It’s available through a command-line interface or a web UI, runs on Linux, macOS, or Windows via WSL2, and needs Docker plus at least 4GB of RAM to operate. The code is released under the GPL-3.0 license, with a separate commercial license available for anyone wanting to use it in closed-source products.
Why It’s Built as a Team of Agents, Not One
The design choice that actually distinguishes BlacksmithAI from other AI security tools isn’t any single feature — it’s the division of labour. Most existing AI security tools rely on a single agent trying to handle every phase of an assessment. The creator’s stated reasoning, given directly to Help Net Security, is that real penetration testing is normally a team effort, with specialists handling different phases rather than one person — or one AI — doing everything at once. The orchestrator acts as the process lead, breaking a complex task into sub-goals and handing each one to whichever specialist agent is built for it, the same way a human pentest lead would divide work across a team.
It’s also explicitly unfinished in some ways worth knowing about. The creator has said future versions aim to add browser interaction — agents currently can’t click buttons or fill out forms, only discover paths and known issues through tools like Nikto and Gobuster — along with support for interactive frameworks like Metasploit and BeEF, integration with external services like Shodan through the Model Context Protocol, and a “skills” system letting agents learn best practices by combining multiple tools rather than using them in isolation.
What’s Actually Inside the Toolkit
The mini-Kali container bundles 28 named, established, professional-grade security tools — the same category of software a human penetration tester would reach for, just orchestrated by AI agents instead of typed by hand.
Reconnaissance
Subdomain finders like assetfinder and subfinder, WHOIS and DNS lookup tools, and network scanning utilities build a map of what’s publicly exposed before anything else happens.
Scanning & Enumeration
nmap for port scanning, nikto for web server scanning, gobuster for directory brute-forcing, and wpscan, a scanner purpose-built to detect outdated WordPress installations among other targets.
Vulnerability Analysis
nuclei, a fast scanner that matches findings against known CVE templates, plus an SSL/TLS configuration checker.
Exploitation & Post-Exploitation
sqlmap for automated SQL injection, hydra and medusa for password brute-forcing, trufflehog for finding exposed credentials, and impacket for Windows protocol manipulation.
Watch — BlacksmithAI Overview
The project’s own demonstration video, linked directly from its GitHub repository. All rights respective owner. Source: YouTube.
Who Actually Benefits From This
The honest answer is a narrower group than the framing of “AI does your security testing now” might suggest. A few categories of people get genuine value out of a tool like this existing, and a few don’t.
✅ Genuinely Useful For
- Self-hosters and small teams who want a structured assessment of their own infrastructure without the cost of hiring a professional penetration testing firm — standard engagements typically run $5,000 to $35,000 in 2026, averaging around $18,300 across test types, according to current industry pricing data
- People learning how penetration testing is actually structured — the orchestrator’s final report shows the reasoning behind each phase, which the documentation itself lists as an explicit use case
- Security researchers and developers who want a GPL-licensed base to extend with their own agents or tools, rather than building multi-agent orchestration logic from scratch
❌ Not Really Built For
- Anyone wanting a fully hands-off, point-and-click experience — setup requires Docker, Python 3.12, and either a paid LLM API key or a locally hosted model with real GPU resources
- Enterprise red teams needing browser-based testing of interactive web functionality — that capability doesn’t exist yet, by the creator’s own admission
- Anyone expecting an established, mature project — it’s a few months old with a single primary maintainer rather than a dedicated team
The Legal Line, Plainly
BlacksmithAI’s own documentation lists its intended uses as security research, education, and authorised assessments — the same legitimate purposes tools like Kali Linux, Nmap, and Metasploit have served for years. Running any penetration testing tool, AI-orchestrated or not, against a system without explicit written permission to test it is illegal in most jurisdictions, regardless of which software is involved.
What It’s Not
It’s not a one-click attack button, and it’s not the only project doing this — it’s one open-source entry in a wider, fast-moving category of AI-driven offensive security tooling that emerged through 2026. As of writing, the project has 222 GitHub stars and 39 forks — a real, growing community, but still a young one.
My Take — Mr Wangdoo
Reading through the documentation and the creator’s own comments, what stands out isn’t really the AI angle — it’s that this is fundamentally a labour-division problem someone solved well. Multiple narrow agents instead of one generalist doing everything is a sensible engineering choice, and it’s the same lesson plenty of software has learned long before AI agents existed; BlacksmithAI just applies it to a domain, offensive security, where the tools being orchestrated are unusually high-stakes.
What I find more interesting than the tool itself is what its existence signals: the orchestration layer that used to require a trained human coordinating several specialised tools by hand is now something a single open-source project can package and give away under GPL. None of the individual tools inside it are new. The packaging is.
What is BlacksmithAI?
An open-source framework, released in March 2026, that uses six coordinated AI agents — one orchestrator and five specialists — to run a full penetration test, from reconnaissance through exploitation and impact assessment.
Who created it, and is it actively maintained?
Yohannes Gebrekirstos created it and has spoken publicly about its design to Help Net Security. As of writing it has 222 GitHub stars and 39 forks, with active development continuing under a single primary maintainer.
What tools does it actually use?
Around twenty established security tools bundled into a shared “mini-Kali” container, including nmap, nikto, sqlmap, nuclei, hydra, and wpscan, organised by which phase of a penetration test they support.
Is it free to use?
Yes, the open-source version is released under GPL-3.0 and free on GitHub. A separate commercial license exists for closed-source use, and a hosted cloud version is available for testing without local setup.
Is it legal to use?
Yes, when run against systems you own or have explicit written permission to test — the same legal standard that applies to any penetration testing tool. Using it without authorisation is illegal in most jurisdictions.
What can’t it do yet?
By the creator’s own account, it can’t yet interact with web pages the way a human would — clicking buttons or filling out forms — and doesn’t yet support interactive frameworks like Metasploit. Both are listed as planned future additions.
Sources & References
- BlacksmithAI — GitHub repository (yohannesgk/blacksmith) — architecture, tool list, license, system requirements, demonstration video
- Help Net Security — BlacksmithAI launch coverage — creator interview and design rationale, March 2, 2026
- Help Net Security — Hottest open-source cybersecurity tools, March 2026 roundup — additional context on coverage and timing
- PenetrationTestingCost.com — 2026 Pentest Cost Benchmarks — average and range pricing for professional penetration testing engagements