Exploratory Testing - Testlio Exploratory Testing QA Company

Regression testing may not be enough

You’ve conducted scripted regression testing and your newest features are not breaking old ones. But alas, software bugs are sneaky – they hide in-between the nooks and crannies of project requirements and user stories.

Testlio’s highly experienced exploratory testers offer an important level of maturity required to uncover hidden issues.

The value Testlio brings is unique, just like their people. They bring thought, originality, and a diverse background of experiences to bear when it comes to testing, and that’s something we’re a long way off from being able to automate.

Jai Govindani

Chief Technology Officer at Red Planet Hotels

What to expect from Testlio’s world-class explorers

Testlio believes that regression tests are enhanced when combined with structured exploratory testing. Exploratory Testing with Testlio means experienced testers are given the freedom to attack the product, even trying to break it, by doing things in combinations not anticipated in the test cases.

Experience

Domain knowledge and a level of maturity essential for efficient exploratory testing and useful feedback.

Flexible. Burstable.

Testers who work in short bursts to avoid fatigue and maintain objectivity – augmenting your QA team during periods of peak demand

Dedicated Team

A dedicated team of testers focused on real-user coverage and the option of fully-managed or co-managed project management support.

No More Dups

Testers that identify important bugs without duplicate issue reporting.

Global Coverage

Testers cover any device, location, language, or internet connection throughout the world.

Rotation

Testers are rotated each cycle to focus on different parts of the application, keeping it fresh.

How Testlio Manages Your Exploratory Testing (Fully-Managed Example)

One

Testlio builds out test charters based on the functionality of the application.
Two

Your Testlio Engagement Manager provides testers with basic exploratory testing guidelines and a set amount of time, but no defined or expected results.
Three

Testers apply their domain knowledge, experience, and skills to explore the functionality of an app and uncover issues.
Four

Neither we nor our clients know what testers will discover.
Five

Testers file issues and leave thoughtful feedback within the Testlio platform
Six

Engagement Manager prepares a test report with qualitative insights on the cycle, top issues, pass/fail results, and recommendations.

Four Exploratory Testing Examples

Testlio’s Structured Exploratory Testing capability helps our clients uncover issues before their customers find them. Testlio does exploratory testing differently by combining a fully-managed or co-managed approach to testing with the help of experienced testers.

Travel App Exploratory Testing

One of our clients, a world leader in the vacation rental industry, provides Web, mobile Web, and mobile app experiences. Their research discovered that customers who install their mobile app tend to be more sticky and provide better lifetime value. Using structured exploratory testing, Testlio probed the user workflows – starting on the Web and mobile Web – looking for prompts to encourage the installation of the mobile app. Our testers found it difficult to discover the mobile app. They provided specific feedback, including recommended prompts to promote app installation, helping the client update the user experience and drive more installs.

Media App Exploratory Testing

A top-five global entertainment company depends on Testlio’s Exploratory Testing capabilities to assure their OTT and mobile streaming apps. For example, testers have free reign to test the client’s video player on multiple devices. Through their exploration, the testers uncover issues related to video playback, pause, rewind, fast forward, screen enlarge, connections, and volume controls. Testers also explore and report on what happens during mobile app interruptions from push notifications, incoming text messages, calls, or when plugging and unplugging headphones.

Internet Buy-Sell Marketplace Exploratory Testing

One of Testlio’s online marketplace clients offers a variety of user-friendly functionality for buying, selling, coordinating in-person meetings to complete transactions, and more. Before conducting exploratory tests, Testlio first runs over 1200 regression tests for mobile (Android and iOS) and Web. While the quantity of regression tests covers most end-user scenarios, other unforeseen user behaviors slip through the cracks.

To augment regression testing, Testlio creates structured exploratory tests. For example, a major feature, say, posting an item for sale, is assigned to test. The testers then explore the feature and go through the smaller steps necessary to complete the task, including editing the items prior and after posting. Testers have the freedom to explore as deeply as possible and uncover relevant scenarios and opportunities for feature enhancements not covered by the regression tests.

Workplace Productivity App Exploratory Testing

Another client asked us to create exploratory test plans from user feedback left on AppReviews. Testlio’s engagement managers developed exploratory test plans based on user feedback. The project managers then assigned the real-world scenarios to experienced exploratory testers who reviewed the end-user complaints and applied their skills to reproduce the issue and uncover new items. Common problems discovered by exploratory testing include issues with loading times, orientation changes, search bars, UX/UI issues, speed, performance, and stability issues related to crashes, flashes, and blinking.

Exploratory Software Testing

Good things happen to good software QA, engineering, and product teams when they partner with Testlio.

Flexible Approach: Testlio does testing differently by offering flexible approaches to testing including fully managed services where we act as your quality team and co-managed options where we extend your team: flexible, burstable, and crowd-scale.
Experienced Testers: Gain confidence that your app receives end-to-end testing from mature and unbiased, real-users who speak QA.
Confidence: Even when no issues are uncovered, you see the test charter, time spent in exploration, and the number of testers assigned.
Reports: Experience dramatically shorter time to build with test cycle insights designed to help you better prioritize your development cycles.