Localization testing best practices: a Q&A with Testlio Test Lead Putu Kusumawardhani

We asked Testlio QA Test Lead and localization testing expert, Putu Kusumawardhani, to share some insights and practical tips including:

  • A framework for a good localization strategy
  • Best practices for a successful localization testing process
  • An example of how a Testlio client localized its offering during the COVID-19 pandemic
About Putu:

With over 8 years of experience working in the hybrid roles of Product Owner + Test Lead in Jakarta and Singapore-based companies, Putu has an extensive understanding of the software testing life cycle. She’s also an ISTQB Certified Tester.

Testlio Test Lead Putu shares insights on localization testing

What is localization testing and why is it Important?

In today’s crowded global market, localization is seen as a competitive advantage to increase customer acquisition and retention. However, delivering a flawless app experience across different markets, while retaining the essence of the brand/product, can be challenging.

Therefore, it is important to factor in localization early in the development stage so that when necessary, the software’s UX and UI can easily be adapted for a target market. Since oftentimes businesses might not have the internal capacity to perform product localization and localization testing, app developers should consider involving a localization partner as early as possible in the process to minimize costs.

Ultimately, consumers expect a native feel (reflecting their language, culture, lifestyle, and values) from a localized product – otherwise, they will quickly uninstall the app.

Related: Why Localization Testing is About More than Language

Localization testing checklist

What elements should be considered for a successful localization strategy?

Here are my 5 tips to build a framework for a solid localization strategy:

1. Define the countries/regions you aim to localize
  • Users’ characteristics: including product usage patterns as well as users’ geodemographics and attitudes
  • Special seasons/public holidays
  • Existing competitor characteristics: including user base and user growth as well as product format (language, wording layout, and content)
  • Your own product characteristics along with the adjustments needed for localization
2. Define the variables you are going to localize
  • For content localization, you need to go deeper than the language itself. You need to understand: local regulations and law, local content interests, as well as local social, religious, and political norms
  • For product localization, you need to make sure you maintain quality throughout the whole process
3. Define when you are going to implement localization for your product
  • It pays to remember that this is not a one-time effort but a continuous process that involves improving the quality of your localized product
  • Furthermore, you need to determine if you are going  to implement a localized marketing strategy
4. Define KPIs

Here are some KPIs to help measure the impact of your localization efforts:

  • % on-time deliveries = Total deliveries on time or early/Total deliveries
  • % localization-related complaints = total localization-related complaints/Total complaints
  • % localization-related bugs = total localization bugs/total bugs
  • % fixed-localization = total passed localization bugs/ total bugs
  • % failed-localization = total failed localization bugs/total bugs
  • Number of users after localization is implemented
5. Define budget and stakeholders
  • Determine the project manager and team members for the localization project, including the technical team.
  • If you don’t have the capacity to perform localization testing in-house, look for a software testing company such as Testlio, that can give you access to an expert network of global testers covering over 150+ countries.

What are some best practices for localization testing?

My best practices for localization testing can be summed up into three main points:

1. Test as early as possible

The earliest you do the localization, the lower the cost will be.

2. Test with competent localized testers

To make sure your product is ready for release around the world, you must test it with local testers skilled in every aspect of localization testing: from language and culture changes, swiping and hardware functionality, to the interplay between translation and UI.

3. Monitor your KPIs

Measure your user growth, analyze existing users, and linguistic-related complaints.

What is your 9-point checklist for localization testing?

Here’s my checklist when performing localization testing:

Point 1: Style guide

What is the product’s tone of voice and language style?

Point 2: Glossaries 

What is the key terminology that needs to be translated?

Point 3: Product or feature specification

What are the requirements?

Point 4: Languages and locations

What languages and locations need to be tested? 

Point 5: Product platform 

Will the testing be performed on a mobile platform, desktop, or AR?

Point 6: Functional/UI testing scope
  • No truncation or overlapping of texts
  • Font size is correct across the application
  • Product layout is consistent with its English version
  • Existing functionality is working even though the language is not in English
Point 7: Location-related testing scope
  • Content of the product is correct based on the region
  • Phone number format, date, time, decimal number format follow language/region standards
  • Colors are appropriate according to local customs.
  • Currency format, temperature format follow language/region standards
  • Flags and countries name are correct
  • Event-based marketing is triggered in the correct season and showing correct context according to the local customs
Point 8: Linguistic testing scope
  • Grammar, spelling, and punctuation are correct
  • Unnatural translation and idiomatic testing (checking if the app tone is in line with Style guidelines) are checked
  • Translation consistency across the product is correct
  • RTL (right to left for Arabic and Urdu Language) format is correct
  • Improvement suggestions from testers to the product
Point 9: Localization impact results
  • Impact of localization testing before and after testing is done, in terms of conversion rates, user growth, and localization-related complaints.

Can you share an example of how Testlio has helped a client with their localization needs?

The most remarkable case happened just shortly after the WHO declared the novel coronavirus (COVID-19) outbreak a global pandemic. In response, one of Testlio’s clients – a top three global social media and photo-sharing app – elected to use its platform to deliver important health information to its users.