How ArborXR expands QA coverage and ships faster with Testlio

Company overview

ArborXR is a platform that helps large companies use AR and VR devices for training and education at scale. Instead of having to set up and manage each training headset one-by-one for its clients’ end users, ArborXR provides organizations with an easier way to handle everything remotely, from adding new apps and updating training content to tracking how devices are being used, all from a single dashboard.

This is especially useful for businesses like Walmart, Delta, and UPS, which use immersive experiences to train employees more effectively. With ArborXR’s software solutions, clients can roll out consistent, hands-on training programs across many locations, while keeping devices secure and easy to manage.

Challenge

ArborXR builds software that powers AR and VR devices used for hands-on training, which makes quality especially critical. Physical headsets introduce variables that automated tests can’t fully capture, since factors like motion tracking, user interaction, comfort, spatial awareness, and real-world environments all affect how AR/VR experiences actually perform. Because of this complexity, fast feedback loops are critical in XR development, as issues can block releases or impact physical device experiences. Before Testlio, ArborXR relied on limited internal QA support, which made it difficult to consistently and quickly test across all the different devices, environments, and global use cases.

This left critical gaps in testing, increasing the likelihood that bugs would make it into live environments, where they could interrupt training sessions, confuse users, or reduce the effectiveness of learning programs. For organizations relying on XR for employee training, even small issues could lead to lost time, lower engagement, and added operational costs.

For ArborXR, these risks went beyond user experience. Unreliable performance could damage client trust, lead to churn, and slow down new deployments. At the same time, longer testing cycles made it harder to release updates quickly, putting them at a disadvantage in a fast-moving and competitive XR market.

To address this, ArborXR sought a scalable testing solution that could extend QA coverage, provide access to global testers, and maintain high product quality without adding internal headcount.

Solution

ArborXR partnered with Testlio to build a QA approach better suited for AR and VR environments, where testing goes beyond traditional software checks. Because XR experiences depend on real-world conditions, like movement, physical space, and device performance, they require human validation across different headsets, locations, and use cases to ensure training runs smoothly in practice, not just in theory.

Working closely with Testlio, ArborXR expanded test coverage across real devices and global testers, while their QA Lead focused on defining high-impact scenarios. Testlio’s team helped operationalize this by managing global testers and identifying edge cases unique to XR, such as motion inconsistencies or environment-specific issues, giving ArborXR more confidence that its platform would perform reliably in real training environments.

Testlio assisted ArborXR in shipping devices globally to crowd testers, handling international logistics, and ensuring new firmware and hardware were validated smoothly across regions. By building a consistent, high-performing tester network, ArborXR was able to streamline validation cycles and reduce the operational overhead required to support global XR testing.

“Testlio has caught countless critical bugs during regression testing. These issues could have easily turned into major incidents. Just as importantly, they surface many smaller issues we’re able to fix before release. Testlio has become incredibly valuable every time we ship.”

– Andrew Bedick, Product Quality and Test Lead

Results

This foundation not only improved day-to-day product quality, but also positioned ArborXR to accelerate larger platform initiatives. It gave the team the confidence and capacity to execute a major platform migration and bring new capabilities to market faster.

Real-device validation across fragmented XR ecosystem

Unlike traditional software, XR performance varies by headset, firmware, and user interaction. 

To uncover edge cases such as motion discomfort, tracking drift, and performance degradation, a structured, multi-tester validation approach was implemented across devices and environments. This approach accounted for the variability and included:

• Coverage extended across multiple VR headset types globally.
• Additional focus applied to most-used hardware devices to ensure production stability.

Rapid testing turnaround for development velocity

To maintain momentum and reduce the risk of delays, a streamlined testing cadence was established to quickly surface and resolve issues before they reached production. This approach enabled: 

• Test cycles completed within 30 - 60 hours across testers.
• Test reports delivered in under 1 business day.
• Developers reduced time spent on manual device validation.

“When we launched Remote View on Meta Quest devices, this was the first feature of its kind in the industry. Testlio was invaluable in helping us test it thoroughly. I can’t overstate how essential their team has been in ensuring a successful release.”

– Andrew Bedick, Product Quality and Test Lead

Scalable QA model without internal overhead

ArborXR could consistently scale testing alongside product growth, maintaining broad device coverage and fast release cycles without adding operational strain to the internal team.

• Full regression testing runs executed on a predictable per-cycle model.
• Enterprise-scale QA coverage was enabled across multiple devices using global testers that did add internal QA overhead.
• Avoided the overhead and operational complexity of managing a large internal or fragmented testing setup in various regions.
• Supported repeatable, scheduled testing cycles that aligned with each release cadence.

55%+ faster platform migration and first to market

By rapidly scaling QA capacity, ArborXR was able to ship a complex platform overhaul significantly faster, reducing time-to-market by 55%+, and minimizing disruption for enterprise customers relying on the XR training system.

• Freed up developer time by offloading device-level and regression testing, allowing engineering teams to focus on building new features and platform improvements.
• A smooth, confident customer migration during rollout was successfully achieved.

‍