Back to Blog

Ten Thousand Applications Before Lunch

Agentic AI has not just industrialized fraud attempts. It has turned your risk model into an unlabeled dataset, one your rejections are quietly labeling for the other side, one attempt at a time.

Views expressed are personal and do not represent any employer, partner, or client.

Picture a single agent working a lending application.

It reads the form. It assembles an identity that holds up under scrutiny: a real SSN paired with a fabricated name, an address with history behind it, a face that passes the selfie check. It submits. Approved.

Then it does it again. And again. Ten thousand times before lunch, each one slightly different from the last, each one learning from the ones that failed.

No human touched any of it.

This is not a forecast. Agentic AI has removed the constraint that quietly governed fraud economics for decades: human effort. Fraud used to be rate-limited by how many applications a person could push through in a day, and by how much a fraud ring was willing to spend on labor. That ceiling is gone.

Removing the labor ceiling is not the deepest change, though. It is the most visible one. The change that matters more, and that most write-ups still bury, is what happens each time your model rejects one of those attempts.

Every decline is training signal.

The agent submits, gets denied, adjusts one variable, submits again. Ten declines later it knows more about your risk boundary than it did at the start. Ten thousand declines later it has effectively reverse-engineered your model without ever seeing it. The attack does not need to steal your parameters. Your rejections are giving them away, one at a time, for free.

That is the shift no fraud stack was designed for. A human adversary probes and adapts on human time. An agent probes and adapts on a training loop. Your defenses become, without meaning to, an unlabeled dataset the other side is quietly using to fit its next attempt to your exact decision surface.

Most fraud stacks were tuned against a human adversary, and that assumption runs deeper than teams usually notice. Velocity limits assume a human-plausible attempt rate. Manual review queues assume the volume of edge cases stays within staffing. Static rules assume the attacker needs weeks to discover them. Verify-once-at-onboarding assumes an identity confirmed at the door stays trustworthy. Every one of those assumptions is calibrated for the wrong opponent.

Both sides have access to the same technology. Only one is running with the brakes on.

The uncomfortable part is the asymmetry in how fast each side can adopt. An attacker adds a new model over a weekend. A defender adds one after procurement, security review, model governance, a validation cycle, and an integration window.

A few shifts follow directly from taking the reverse-engineering seriously. Detection has to operate at the same clock speed as the attack. If your adversary adapts in hours and your controls update quarterly, the gap between them is where all your losses live.

Treat "too clean" as a signal. Human applicants hesitate. They mistype and correct. They tab backward. An agent that fills a form perfectly, at uniform speed, with no revisions is exhibiting behavior no legitimate user produces. Perfection is anomalous.

Lean on signals that are expensive to synthesize. Document forensics, biometric liveness, device and behavioral telemetry. Signals grounded in physical reality are harder to generate at scale than any data an agent can compose from a breach dump.

Assume your model is being probed. If a stream of near-miss applications is walking steadily toward your approval threshold, that is not noise. That is reconnaissance, and it deserves its own detection. The near-miss is the visible half of the reverse-engineering. Watching for it is the closest thing to catching the probe as it happens.

None of that eliminates the underlying asymmetry. It only closes the gap. The fraudster that never sleeps is already in your funnel. The honest question is not whether your controls stopped fraud last quarter. It is whether they would hold against an adversary that can test them ten thousand times before you finish reading this.


Shyam Menon is a product leader specializing in fraud and identity in financial services. This is one of a series of framework posts on how to think about fraud prevention, identity, and AI products in regulated industries. He writes at shyammenon.com.