Testlio Launches Human-in-the-Loop Testing for AI Agents

AUSTIN, TX — JUNE 3, 2026 — Testlio, a leading AI-powered crowdsourced testing platform, today announced the launch of AI Agent Testing services at Money20/20 Europe. The comprehensive offering integrates Testlio's human-in-the-loop (HITL) orchestration and proprietary AI-driven insights from 13+ years of QA expertise into agentic workflows. 

As enterprise adoption of AI agents rapidly accelerates, the transition from passive software to decision-making agents introduces critical hidden vulnerabilities. Recent research shows that 79% of enterprises have implemented AI agents at some level, yet most AI agents complete tasks successfully on the first try only 24% of the time. 

Choosing Money20/20 Europe for the debut highlights the highest-stakes frontier for this technology: the intersection of AI autonomy and financial transaction. Here, the margin for error drops to zero.

“Testlio is uniquely positioned for this moment, combining years of proven global payments testing with this new AI agent validation service,” said Summer Weisberg, CEO at Testlio. “As enterprise AI agents evolve from handling simple customer queries to executing complex agentic payment workflows, where AI is granted digital wallets to independently authorize transactions, organizations need a partner that goes beyond automated simulation. They need access to humans with real, localized payment methods to act as a safety net, alongside experts specializing in AI agent evaluation. That’s exactly what Testlio provides.” 

Solving the Four Critical Pillars of AI Risk

An agent that performs in a controlled run can still break the moment it meets a real device, a regional payment flow, or a user who doesn't follow the script. Testlio’s AI-certified global testing community validates agentic workflows in the unpredictable conditions where failures actually occur. Testlio solves the most critical financial, compliance, and brand safety challenges teams face today with their agentic workflows:

• Agents fail across unpredictable real-world cases. Testlio's AI-certified testers run thousands of what-if scenarios to keep agents contextual and brands out of trouble.
• Automation-only evaluations miss nuanced issues. Testlio’s proprietary evaluation framework captures the subtle risks and behavioral issues that automation overlooks. 
• Agentic failures show up as quiet liabilities and policy violations. Testlio verifies data moves accurately between steps, catching critical leaks before customers do.
• Companies that release fast are often at the highest risk of losing years of trust. Testlio matches rapid deployment cycles with high-velocity, real-time insights.

All findings feed into LeoPulse™, Testlio's proprietary AI confidence score, which informs release decisions and serves as a benchmark and recommendation engine for measuring improvements over time.

A Trusted Partner in High-Stakes Validation

For more than a decade, Testlio has been the trusted QA partner for enterprises across finance, ecommerce, media, and software, sectors where a single glitch can ripple into a damaged brand, severe regulatory penalties, and millions in lost revenue. This extensive history in high-stakes validation forms the foundation for Testlio’s new AI testing services, as it proves Testlio already processes the global infrastructure and localization payment rails that AI agents will eventually interact with.

“Autonomous agents require an entirely new testing playbook,” said Dean Hickman-Smith, CRO at Testlio. “The future of AI testing is not automation alone. It’s AI combined with localized human judgment, real-world validation, and continuous feedback loops that enterprises can trust at scale.”

Global brands including PayPal, NBCUniversal, Strava, Adyen, Dlocal, Uber, and Solidgate rely on Testlio to validate high-stakes digital experiences across payments, streaming, mobile, and AI-driven workflows.

Solidgate, a payment orchestration platform operating in 150+ markets, recently partnered with Testlio to ensure its embedded payment solutions performed seamlessly across diverse regional standards, achieving a production issue resolution rate that exceeded 95 percent. It is this exact, proven network of real-world payment testers that Testlio is now leveraging to safeguard the next generation of AI agents. 

“Working with Testlio allowed us to catch critical issues we wouldn’t have seen otherwise. The feedback from in-market testers gave us confidence that our payment flows work as expected, and we could address problems before they reached our customers,” said Stefan Dzhenkov, Head of Alternative and Local Payments, Solidgate. 

To learn more, visit the Testlio team at Money20/20 Europe (booth #K21), or go to: https://www.testlio.com/solutions/ai-testing/agent-testing.

About Testlio

Testlio’s fully managed and AI-driven crowdsourced testing platform connects global quality experts with product and engineering teams to ensure every release works for every user, everywhere. The company is 100% remote, with team members in 150+ countries. Female-founded, approximately 46% of full-time employees are women. Testlio’s clients include some of the world’s leading brands, such as Paramount, Paypal, Clari, Strava, Merck, and more. As an ISO 27001:2022 certified vendor and trusted Microsoft Supplier, we apply rigorous security measures aligned with global privacy and compliance expectations to every client engagement. Learn more at testlio.com.