• Become a Tester
  • Sign in
  • The Testlio Advantage
    • Why We Are Different

      See what makes Testlio the leading choice for enterprises.

    • Our Solutions

      A breakdown of our core QA services and capabilities.

    • The Testlio Network

      Learn about our curated community of expert testers.

    • Our Platform

      Dive into the technology behind Testlio’s testing engine.

    • Why Crowdsourced Testing?

      Discover how our managed model drives quality at scale.

  • Our Solutions
    • By Capability
      • Manual Testing
      • Test Automation
      • Payments Testing
      • AI Testing
      • Functional Testing
      • Regression Testing
      • Accessibility Testing
      • Localization Testing
      • Customer Journey Testing
      • Usability Testing
    • By Technology
      • Mobile App Testing
      • Web Testing
      • Location Testing
      • Stream Testing
      • Device Testing
      • Voice Testing
    • By Industry
      • Commerce & Retail
      • Finance & Banking
      • Health & Wellness
      • Media & Entertainment
      • Learning & Education
      • Mobility & Travel
      • Software & Services
    • By Job Function
      • Engineering
      • QA Teams
      • Product Teams
  • Resources
    • Blog

      Insights, trends, and expert perspectives on modern software testing.

    • Webinars & Events

      Live and on-demand sessions with QA leaders and product experts.

    • Case Studies

      Real-world examples of how Testlio helps teams deliver quality at scale.

Contact sales
Contact sales

How Many Mobile Device And OS Combinations Should You Test?

Arpita Goala , Content Marketing Manager
January 22nd, 2020

Testlio finds that leading app providers test 24 mobile device-OS combinations on average.

January 22, 2020. Austin, TX. Today, users access mobile apps through devices that offer thousands of combinations of screen sizes and operating systems, leaving app QA managers with a challenging decision of how many and which devices to prioritize.

This week, managed app testing company Testlio released new mobile device testing data from a recent query of its client base, providing a unique look into the number and most common mobile device/OS testing combinations among some of today’s QA testing leaders. The data set includes QA testing data from 31K+ client test records spanning a diverse range of industries (including commerce, education, entertainment, finance, productivity, sports, and travel). Collectively, these Testlio clients have a user base of more than 1.65 billion people.

Testlio QA Insights Infographic with Data on the most common device and OS combinations to QA test
Testlio QA Insights – Most common device and OS combinations

As a benchmark for other app providers, Testlio identified the top ten most frequently tested mobile device and operating system combinations from their 2019 customer data:

  1. Google Nexus 5X Android 8.1
  2. Apple iPhone 6s iOS 11.4.1
  3. Samsung Galaxy S7 Android 8.0
  4. Google Pixel 2 XL Android 9.0
  5. Apple iPhone 5 iOS 10.3.3
  6. Apple iPhone X iOS 12.3.1
  7. Xiaomi Mi A1 Android 9.0
  8. Google Nexus 6P Android 8.1
  9. Google Pixel Android 9.0
  10. Apple iPhone 7 iOS 12.3.1

Based on a comprehensive analysis of client release data and device-OS configuration tests, Testlio also found leading mobile app companies follow a best practice of releasing mobile apps every 1 or 2 weeks, and testing 24 or more unique device-OS combinations before each update.

We live in a world of increasingly diverse and personalized mobile experiences. We’re thrilled to see our clients embrace a human-driven approach to real device/OS testing, and we salute our clients’ collective approach to testing ~24 device/OS combinations per mobile app release.

Testlio CEO, Steve Semelsberger

Cross-platform testing — testing across multiple devices and operating systems — is not only essential to ensure a quality customer experience across the myriad of different mobile environments, but also to keep up with frequent updates to the Google Play and Apple App stores. When prioritizing mobile device testing, we recommend QA managers consider the data above, as well as the top mobile app testing devices and operating systems currently available.

For easy reference to perspectives on mobile device testing, please grab the infographic.

About Testlio
Testlio is the leader in managed app testing. With robust client services, a global network of validated testers, and a comprehensive software platform, we provide a suite of flexible, scalable, and on-demand testing solutions: end-to-end, usability, localization, functional, payments, and more. Testlio clients include American Express, CBS, Hotels.com, Microsoft, the NBA, and Vrbo. When apps must perform brilliantly, Testlio helps ensure world-class customer experiences. In any location. On any device. In any language.

You may also like

  • Advice Top Managed Software Testing Services in 2025
  • Advice How to Test AI Applications: Frameworks, Metrics, and Methods
  • Advice Automated Testing Strategy: How to Develop Yours [ +Template]
  • Advice What is a Bug Report? How to Write Your Own [+ Template]
  • Advice Android Test Automation: Why & How You Can Automate Testing
  • LinkedIn
Company
  • About Testlio
  • Leadership Team
  • News
  • Partnerships
  • Careers
  • Become a Tester
  • Platform Login
  • Contact Us
Resources
  • Blog
  • Webinars & Events
  • Case Studies
Legal
  • Notices
  • Privacy Policy
  • Terms of Use
  • Modern Slavery Policy

Subscribe
to our newsletter