Search
Picture of Joe Haskins

Joe Haskins

Joe Haskins is a Security Research and Development Engineer at Edgescan, where he helps design and build Edgescan’s AI-driven penetration testing and DAST solutions. He brings almost a decade of experience in tech, with a background in security consultancy and hands-on penetration testing. His work spans both research and engineering: exploring new and established testing techniques and building them into the agents, tooling and infrastructure that power Edgescan Atomic.
Explore the Article

AI-Powered Penetration Testing: Why AI Models aren’t enough

On October 21, PHP shipped fixes for PHP2Shell, two flaws that can allow unauthenticated remote code execution on PHP installations serving web requests. Early signs of the underlying memory problem were spotted in 2024, and work on a fix stalled for months. Then AI models made it practical to chain the flaws and adapt them to each target. Working exploits followed within hours.

That is what frontier AI brings to offensive security. It reads code, forms hypotheses, chains weaknesses together, and adapts as it goes. Attackers have that capability now. Defenders need it too.

But capability is only half the question. The other half is what happens when that capability is pointed at your production application.

What AI-powered penetration testing can do

Atomic, Edgescan’s autonomous penetration testing capability, puts that kind of reasoning to work for you. It explores an application, builds a picture of how it works, investigates potential weaknesses, and chains issues into attack paths. When one finding opens a door, Atomic follows it and revises its plan as it learns.

This is the work that has always set a penetration test apart from a scan. A scanner checks for known patterns. An attacker asks what a weakness makes possible next. Atomic asks that second question, at a speed and frequency that makes testing between expert-led engagements practical.

Then ask what could go wrong

The reasoning that makes a model useful also makes it unpredictable. Frontier models are probabilistic. Put the same situation in front of one twice and it can propose two different actions. Most proposals will be sensible. Some won’t be.

In security testing, a bad decision can have real consequences. An AI model might propose retrieving more data than it needs to prove a vulnerability. It might suggest a request that changes something it should only be reading, or it could attempt an action outside that agreed testing scope.

Finding a vulnerability is one thing; making sure the testing itself doesn’t become the problem is another.

SQL injection example

Take SQL injection as an example. A model investigating a potential vulnerability might propose a request that could alter or delete data. The ability to identify and investigate that weakness is valuable, but a proposed action that could damage the application should never be executed simply because the model suggested it. So the real question for any autonomous testing product is what stops the model from doing something it shouldn’t.

What sits behind the model

Connecting a frontier model to a target gives you reasoning. It doesn’t give you scope enforcement, safe execution, verified findings, or a record of what happened. Those come from the engineering around the model. Atomic is built in layers, and the model is one of them.

Edgescan intelligence gives it a head start. Atomic builds its plan from what Edgescan already knows about your application: the attack surface, known endpoints, and previously validated findings. That context comes from a platform that has validated more than 20 million vulnerabilities, so Atomic’s reasoning goes to the parts of an application that need it.

The Harness holds the boundary. The Edgescan Harness is a deterministic control layer between reasoning and execution. Atomic proposes an action. The Harness checks the target against the authorized scope, checks the tool against an allowlist of approved capabilities, and sets the security-sensitive parameters itself. Then the Harness makes the tool call. Atomic never holds the tools. Anything ambiguous, malformed, or out of scope is refused, because the controls fail closed.

Execution is constrained by design. Agents choose from vetted test points and payloads rather than writing their own attack strings. Credentials stay below the agent layer, and sensitive values are redacted before an agent sees a response. Repeatable work, such as replaying a login once it has been worked out, is handled by the Harness instead of being rediscovered by an agent on every run.

Findings are verified independently. A result that looks like a vulnerability isn’t reported on the word of the agent that found it. Separate verification agents attempt to reproduce it, and only confirmed findings reach the platform. Anything that can’t be confirmed is marked as unverified, with the reason attached.

It’s built by people who test for a living. Atomic’s build team includes experienced penetration testers, and Edgescan’s wider testing department shapes its design decisions. Expert-led penetration testing continues alongside it, where human judgment is required.

Why the separation matters

Each of those layers rests on one decision. The model provides the intelligence. The Harness provides the control.

Instructions in a prompt can guide a model, but they can’t bind it. A model following an instruction is interpreting text, and interpretation shifts with phrasing and context. Scope enforced in code behaves the same way every time, and it can be tested to prove it.

The separation also keeps pace with the field. Models improve quickly. Because the Harness sits apart from them, Atomic’s reasoning can get better without reopening the question of what it’s allowed to do.

And it produces a record. Every action is proposed, evaluated, and either executed or refused at a single boundary. When someone asks what ran against an environment, under what authority, and with what proof, the answer is already written down.

Powerful AI is changing what’s possible in penetration testing, but capability alone isn’t enough.

Atomic brings together AI-powered testing, Edgescans, security intelligence, and engineered controls to investigate vulnerabilities, validate findings, and keep execution with defined boundaries.

Because it’s not just what AI can do, it’s how it’s built to do it.

See how Atomic tests inside enforced controls. Book a demo.

Want to see Atomic for yourself? Join the Atomic Under the Hood sessions with Michael and see how it works, how we keep autonomous testing safe, what we’ve learned, and how it all stacks up.

Related Articles

On October 21, PHP shipped fixes for PHP2Shell, two flaws that can allow unauthenticated remote code execution on PHP installations …

Security is not static. Applications evolve daily, attack surfaces grow, and the risk picture shifts with every release. Your approach …

The code behind PHP2Shell sat in PHP for more than a decade. With AI, researchers turned it into a working …

Ready for security that is fast, accurate and quiet?
Experience the hybrid advantage of AI Scale + Human Validation.