Regression testing may not be enough
You’ve conducted scripted regression testing and your newest features are not breaking old ones. But alas, software bugs are sneaky – they hide in-between the nooks and crannies of project requirements and user stories.
Testlio’s highly experienced exploratory testers offer an important level of maturity required to uncover hidden issues.
The value Testlio brings is unique, just like their people. They bring thought, originality, and a diverse background of experiences to bear when it comes to testing, and that’s something we’re a long way off from being able to automate.
Domain knowledge and a level of maturity essential for efficient exploratory testing and useful feedback.
Testers who work in short bursts to avoid fatigue and maintain objectivity – augmenting your QA team during periods of peak demand
A dedicated team of project managers and testers focused on different parts of your application for real-user coverage.
Testers that identify important bugs without duplicate issue reporting.
Testers cover any device, location, language, or internet connection throughout the world.
Testers are rotated each cycle to focus on different parts of the application, keeping it fresh.
How Testlio Manages Your Exploratory Testing
-
OneTestlio builds out test charters based on the functionality of the application. -
TwoYour Testlio Project Manager provides testers with basic exploratory testing guidelines and a set amount of time, but no defined or expected results.
-
ThreeTesters apply their domain knowledge, experience, and skills to explore the functionality of an app and uncover issues.
-
FourNeither we nor our clients know what testers will discover.
-
FiveTesters file issues and leave thoughtful feedback within the Testlio platform
-
SixProject Manager prepares a test report with qualitative insights on the cycle, top issues, pass/fail results, and recommendations.
One of our clients, a world leader in the vacation rental industry, provides Web, mobile Web, and mobile app experiences. Their research discovered that customers who install their mobile app tend to be more sticky and provide better lifetime value. Using structured exploratory testing, Testlio probed the user workflows – starting on the Web and mobile Web – looking for prompts to encourage the installation of the mobile app. Our testers found it difficult to discover the mobile app. They provided specific feedback, including recommended prompts to promote app installation, helping the client update the user experience and drive more installs.
A top-five global entertainment company depends on Testlio’s Exploratory Testing capabilities to assure their OTT and mobile streaming apps. For example, testers have free reign to test the client’s video player on multiple devices. Through their exploration, the testers uncover issues related to video playback, pause, rewind, fast forward, screen enlarge, connections, and volume controls. Testers also explore and report on what happens during mobile app interruptions from push notifications, incoming text messages, calls, or when plugging and unplugging headphones.
One of Testlio’s online marketplace clients offers a variety of user-friendly functionality for buying, selling, coordinating in-person meetings to complete transactions, and more. Before conducting exploratory tests, Testlio first runs over 1200 regression tests for mobile (Android and iOS) and Web. While the quantity of regression tests covers most end-user scenarios, other unforeseen user behaviors slip through the cracks.
To augment regression testing, Testlio creates structured exploratory tests. For example, a major feature, say, posting an item for sale, is assigned to test. The testers then explore the feature and go through the smaller steps necessary to complete the task, including editing the items prior and after posting. Testers have the freedom to explore as deeply as possible and uncover relevant scenarios and opportunities for feature enhancements not covered by the regression tests.
Another client asked us to create exploratory test plans from user feedback left on AppReviews. Testlio’s QA project managers developed exploratory test plans based on user feedback. The project managers then assigned the real-world scenarios to experienced exploratory testers who reviewed the end-user complaints and applied their skills to reproduce the issue and uncover new items. Common problems discovered by exploratory testing include issues with loading times, orientation changes, search bars, UX/UI issues, speed, performance, and stability issues related to crashes, flashes, and blinking.
Exploratory Software Testing
Good things happen to good software QA, engineering, and product teams when they partner with Testlio.
-
Do It For Me: We build test charters to provide structure and prevent duplication of tests. We also manage the testers and filter results.
-
Experienced Testers: Gain confidence that your app receives end-to-end testing from mature and unbiased, real-users who speak QA.
-
Confidence: Even when no issues are uncovered, you see the test charter, time spent in exploration, and the number of testers assigned.
-
Reports: Experience dramatically shorter time to build with test cycle insights designed to help you better prioritize your development cycles.
Find Out More
Our Clients
From leading brands to emerging companies, our clients support more than 1.5 billion users and are organizations of all sizes.
