Bulletproofing Field Operations and Data Integrity for System Surveyor
Company Overview
System Surveyor is an award-winning, B2B mobile and cloud-based platform that enables commercial contractors, system integrators, and security professionals to collaboratively plan, design, and manage physical security systems. Often deployed to large multi-site commercial, education, healthcare and manufacturing companies and organizations, the software replaces traditional paper blueprints and CAD files with an intuitive drag-and-drop interface. Users can upload floor plans, map out project grids, visualize camera coverage radii, and automatically generate deliverables. System Surveyor has partnered with Testlio as its QA provider since December 2020.
Challenge
Field surveying takes place in rugged, dynamic conditions far removed from pristine office Wi-Fi networks. Technicians frequently operate in basements, construction sites, or remote facilities with spotty 3G/4G connectivity, low-tier cellular data, or total offline states, creating several critical operational risks.
Unpredictable Connectivity & Sync Issues
Mobile users frequently encountered connection drops while attempting to sync heavy PDF floor plans, high-resolution photo attachments, and vector annotations.
Hardware & OS diversity
The primary audience relied on a wide range of iOS, iPadOS, and Android devices, each handling camera drivers, memory management, and screen orientations differently.
Data Loss & Corruption Risks
Concurrent edits made by mobile app users and web-based project managers often led to untracked sync conflicts or silent data overwrites.
Performance Degradation
Managing large surveys that contained hundreds of physical elements, cables, and photo attachments frequently caused application slowdowns, UI freezes, and infinite loading states.
Out in the field, network conditions create real data sync hurdles. The data showed our clients were running into escaped issues on job sites, but whenever we tried to test for them internally, we just couldn't recreate those failures in a lab environment.
– Arjun Seshadri, VP Engineering at System Surveyor
To address these challenges, System Surveyor needed a testing partner capable of executing complex, large-scale testing scenarios while simultaneously replicating authentic, unpredictable field environments that traditional lab testing simply couldn't match.
Solution
Recognizing that lab-based network throttling cannot mimic the realities of a construction site, Testlio leveraged its global freelance community to execute highly unique, real-world testing.
Overcoming Network Instability
To evaluate network resilience under true field conditions, Testlio recruited testers to take the System Surveyor app on the road. They physically drove across local areas to bounce between different cell towers and Wi-Fi networks to authentically replicate the connectivity drops that actual clients experience. During these field runs, testing teams evaluated how smoothly the application managed offline transitions, while intentionally interrupting background syncs in dead zones to verify that incomplete uploads recovered safely. By subjecting the app to these harsh real-world conditions, Testlio successfully reproduced and identified elusive data synchronization issues that previously escaped into production.
Maximizing Hardware Stability
To account for hardware diversity, testers used a wide variety of iOS, iPadOS, and Android devices to verify that native camera orientation controls functioned consistently across every platform. Testers evaluated performance on real devices using large files, like complex vector drawings and multi-page PDF floor plans. These real-world checks ensured that taking, annotating, and replacing high-res photos would not freeze the screen or crash the app.
Unifying Field & Web Teams
Testing teams coordinated live conflict scenarios where field testers on mobile devices and web users in office settings modified floor plans, element profiles, and site boundaries simultaneously. These tests verified that the application handled concurrent edits gracefully, prompting users to resolve conflicts without silently overwriting critical edits or losing newly added floor plan elements.
I really appreciate how Testlio works directly with us to develop and refine process changes that continuously benefit our engineering workflows and platform delivery.
– Arjun Seshadri, VP Engineering at System Surveyor
Results
Through comprehensive field testing, testing teams systematically exposed the most critical vulnerabilities in the application before they could reach live client environments. By subjecting the app to unpredictable field conditions, testing uncovered severe crashes, data corruption, and multi-user conflict errors that standard lab testing missed.
Intercepting High-Severity Showstoppers
Field testing revealed that 25% of all identified issues were critical functional blockers capable of causing severe failures during live client walkthroughs, including:
- Camera Crashes & UI Lockups: Tapping the camera icon to attach site evidence caused sudden app crashes on Android devices or locked the app in portrait mode, rendering the floor plan interface unusable.
- Thumbnail & Canvas Mismatches: Replacing a floor plan updated the thumbnail preview while leaving the main survey canvas displaying the outdated image.
- Multi-Page PDF Import Failures: Importing multi-page PDF floor plans caused the application to freeze or crash entirely.
Resolving these high-severity defects guaranteed seamless, glitch-free site walks for field engineers, enabling them to capture site evidence confidently and deliver flawless floor plan designs to prospective clients.
Uncovering and Resolving Network Sync Defects
Testing under forced connection drops and spotty cellular coverage exposed over 50 severe synchronization vulnerabilities, including:
- Stuck Sync States & Partial Uploads: Live network drops triggered premature partial updates, trapping local devices in an infinite "Syncing" status after reconnecting.
- Vanishing Local Surveys: Newly created surveys occasionally vanished from local devices despite the app indicating a successful sync status.
- Lost Photos & Attachments: Weak 3G connections frequently caused attached site photos and files to drop during background uploads.
Fixing these sync defects eliminated costly rework for field teams, giving system integrators total confidence that their site surveys, photos, and project data are safely preserved, even in zero-coverage dead zones.
Eliminating Multi-User Conflict Errors
Testing concurrent workflows between mobile technicians and web users exposed several critical multi-user sync flaws, including:
- Disappearing Survey Items: When both field and office users edited a survey at the same time, resolving the clash would delete newly added data instead of saving it.
- Missed Conflict Warnings: When two people modified the same project simultaneously, the app failed to alert them of overlapping edits, letting changes silently overwrite each other.
- Misleading Status Messages: After site boundaries were deleted on a mobile device, the app's conflict pop-up incorrectly claimed No changes were made, confusing users about what was actually modified.
Refining these conflict-handling algorithms safeguarded real-time collaboration between office and field teams, ensuring joint project edits merged seamlessly without data overwrites or lost work.
The communication between our teams has been exceptional and extremely valuable. Testlio’s test leads are seamless partners who are collaborative, proactive, and very easy to work with.
– Arjun Seshadri, VP Engineering at System Surveyor