How Many Mobile Device And OS Combinations Should You Test?

Testlio finds that leading app providers test 24 mobile device-OS combinations on average.

January 22, 2020. Austin, TX. Today, users access mobile apps through devices that offer thousands of combinations of screen sizes and operating systems, leaving app QA managers with a challenging decision of how many and which devices to prioritize.

Testlio QA Insights Infographic with Data on the most common device and OS combinations to QA test
Testlio QA Insights – Most common device and OS combinations

As a benchmark for other app providers, Testlio identified the top ten most frequently tested mobile device and operating system combinations from their 2019 customer data:

  1. Google Nexus 5X Android 8.1
  2. Apple iPhone 6s iOS 11.4.1
  3. Samsung Galaxy S7 Android 8.0
  4. Google Pixel 2 XL Android 9.0
  5. Apple iPhone 5 iOS 10.3.3
  6. Apple iPhone X iOS 12.3.1
  7. Xiaomi Mi A1 Android 9.0
  8. Google Nexus 6P Android 8.1
  9. Google Pixel Android 9.0
  10. Apple iPhone 7 iOS 12.3.1

We live in a world of increasingly diverse and personalized mobile experiences. We’re thrilled to see our clients embrace a human-driven approach to real device/OS testing, and we salute our clients’ collective approach to testing ~24 device/OS combinations per mobile app release.

Testlio CEO, Steve Semelsberger