Regression testing may not be enough

You’ve conducted scripted regression testing and your newest features are not breaking old ones. But alas, software bugs are sneaky – they hide in-between the nooks and crannies of project requirements and user stories.

Testlio’s highly experienced exploratory testers offer an important level of maturity required to uncover hidden issues.

The value Testlio brings is unique, just like their people. They bring thought, originality, and a diverse background of experiences to bear when it comes to testing, and that’s something we’re a long way off from being able to automate.

Jai Govindani
Chief Technology Officer at Red Planet Hotels

What to expect from Testlio’s world-class explorers

Testlio believes that regression tests are enhanced when combined with structured exploratory testing. Exploratory Testing with Testlio means experienced testers are given the freedom to attack the product, even trying to break it, by doing things in combinations not anticipated in the test cases.

Experience

Domain knowledge and a level of maturity essential for efficient exploratory testing and useful feedback.

Flexible. Burstable.

Testers who work in short bursts to avoid fatigue and maintain objectivity – augmenting your QA team during periods of peak demand

Dedicated Team

A dedicated team of project managers and testers focused on different parts of your application for real-user coverage.

No More Dups

Testers that identify important bugs without duplicate issue reporting.

Global Coverage

Testers cover any device, location, language, or internet connection throughout the world.

Rotation

Testers are rotated each cycle to focus on different parts of the application, keeping it fresh.

How Testlio Manages Your Exploratory Testing

  • Testlio QA Testing Company
    One
    Testlio builds out test charters based on the functionality of the application.
  • Testlio QA Testing Company
    Two
    Your Testlio Project Manager provides testers with basic exploratory testing guidelines and a set amount of time, but no defined or expected results.
  • Testlio QA Testing Company
    Three
    Testers apply their domain knowledge, experience, and skills to explore the functionality of an app and uncover issues.
  • Testlio QA Testing Company
    Four
    Neither we nor our clients know what testers will discover.
  • Testlio QA Testing Company
    Five
    Testers file issues and leave thoughtful feedback within the Testlio platform
  • Testlio QA Testing Company
    Six
    Project Manager prepares a test report with qualitative insights on the cycle, top issues, pass/fail results, and recommendations.

Four Exploratory Testing Examples

Testlio’s Structured Exploratory Testing capability helps our clients uncover issues before their customers find them. Testlio does exploratory testing differently by combining “do-it-for-me” managed services with experienced testers.

Travel App Exploratory Testing

One of our clients, a world leader in the vacation rental industry, provides Web, mobile Web, and mobile app experiences. Their research discovered that customers who install their mobile app tend to be more sticky and provide better lifetime value. Using structured exploratory testing, Testlio probed the user workflows – starting on the Web and mobile Web – looking for prompts to encourage the installation of the mobile app. Our testers found it difficult to discover the mobile app. They provided specific feedback, including recommended prompts to promote app installation, helping the client update the user experience and drive more installs.

Media App Exploratory Testing

A top-five global entertainment company depends on Testlio’s Exploratory Testing capabilities to assure their OTT and mobile streaming apps. For example, testers have free reign to test the client’s video player on multiple devices. Through their exploration, the testers uncover issues related to video playback, pause, rewind, fast forward, screen enlarge, connections, and volume controls. Testers also explore and report on what happens during mobile app interruptions from push notifications, incoming text messages, calls, or when plugging and unplugging headphones.

Internet Buy-Sell Marketplace Exploratory Testing

One of Testlio’s online marketplace clients offers a variety of user-friendly functionality for buying, selling, coordinating in-person meetings to complete transactions, and more. Before conducting exploratory tests, Testlio first runs over 1200 regression tests for mobile (Android and iOS) and Web. While the quantity of regression tests covers most end-user scenarios, other unforeseen user behaviors slip through the cracks.

To augment regression testing, Testlio creates structured exploratory tests. For example, a major feature, say, posting an item for sale, is assigned to test. The testers then explore the feature and go through the smaller steps necessary to complete the task, including editing the items prior and after posting. Testers have the freedom to explore as deeply as possible and uncover relevant scenarios and opportunities for feature enhancements not covered by the regression tests.

Workplace Productivity App Exploratory Testing

Another client asked us to create exploratory test plans from user feedback left on AppReviews. Testlio’s QA project managers developed exploratory test plans based on user feedback. The project managers then assigned the real-world scenarios to experienced exploratory testers who reviewed the end-user complaints and applied their skills to reproduce the issue and uncover new items. Common problems discovered by exploratory testing include issues with loading times, orientation changes, search bars, UX/UI issues, speed, performance, and stability issues related to crashes, flashes, and blinking.

 

 

 

 

Exploratory Software Testing

Good things happen to good software QA, engineering, and product teams when they partner with Testlio.

  • Do It For Me: We build test charters to provide structure and prevent duplication of tests. We also manage the testers and filter results.
  • Experienced Testers: Gain confidence that your app receives end-to-end testing from mature and unbiased, real-users who speak QA.
  • Confidence: Even when no issues are uncovered, you see the test charter, time spent in exploration, and the number of testers assigned.
  • Reports: Experience dramatically shorter time to build with test cycle insights designed to help you better prioritize your development cycles.

Find Out More

Schedule a chat with one of our testing experts to discover how we can make Usability Testing painless for your organization
  • This field is for validation purposes and should be left unchanged.

Our Clients

From leading brands to emerging companies, our clients support more than 1.5 billion users and are organizations of all sizes.

Testlio QA Testing for American Express
Testlio QA Testing for CBS
Testlio QA Testing for Hotels.com
Testlio QA Testing for Microsoft
Testlio QA Testing for the NBA