Benchmark the UX performance of your product in China using quantitative metrics

The digital landscape in China moves at a fast pace. Innovations and fierce competition in digital user experience appear across different industries. Benchmarking is a powerful tool to quantify the usability of your product and to help your organization measure the user experience over a duration of time. We use UX benchmarking to collect meaningful quantitative usability data, to help you identify product strengths and weaknesses, and make actionable design & business decisions.

Compare your product to best-in-class competitors in China

When entering your product and trying to see how your product compares to best-in-class Chinese competitors, the ideal methodology is a UX benchmark comparison. Our team will review your product, helps you identify who your competitors are, and designs in-depth benchmarking tests with a focus on testing your product against the key features and functionalities of local products.

Track the UX performance of your product over time

Benchmarking your product over time is the most powerful way to measure the improvements and pain-points in the performance of your UX as you make changes. By capturing quantitative metrics we're able to first create a baseline. With each major change to your product, we run the same benchmark test to be able to compare metrics and quantify the effects these changes had to the user experience.

"We've been working with the team at UX Spot for several months now conducting research projects to localize our product. Apart from top notch facilities in Shanghai, their expertise and flexibility has helped us uncover new user insights that were key to strengthen our position in China."

Client Testimonial

Alberto Kok - Senior UX Research at Agoda.com

UX Benchmarking in our Shanghai lab

UX Benchmarking in our Shanghai lab

Meet our researchers

Samuel Jesse

Samuel has been living in China for over 10 years researching UX, designing and developing products, with a focus on helping western brands localize their products and customer experiences in China. His unique combination of skills and cross-cultural understanding provides an invaluable bridge into China when looking to run a successful UX research project.

We track a series of metrics to quantify the usability of your product

We collect a range of quantitative usability metrics from the tasks performed by your target participants. Our team of UX researchers have developed a series of tools to help observe, record and measure time, steps, success and self-evaluation of users as they benchmark test. These include:

  • Number of steps to achieve a task
  • Task success/failure rates
  • Time taken to achieve tasks
  • Self-evaluation questionnaires such as SEQ/SUS/NPS

Using our custom-designed scoring system, we provide you with clear and visualized reporting of all tasks that allow you to identify pain-points and make data-driven decisions.

Capture qualitative insights to paint the full picture

Quantitative benchmarking provides a bounty of valuable data, but being able to answer the 'why' is a crucial part of understanding the reasons behind successes or failures in your benchmarking tests. We recommend pairing any benchmark study with qualitative usability testing interview questions to be able to probe on attitudes to uncover the reasons for users behaviours.

The right participants for your tests

Over the years we've built a vast database of quality participants across China. For each project, we deploy a bespoke and in-depth screening process to ensure high-quality and target users. Contact us today with your project brief and your recruitment criteria and we can provide a quote within 24 hours.

We help best in class companies run UX research in China.

Our UX benchmarking process

Our detailed methodology and approach lead to success. 

Frequently asked questions on UX benchmarking in China

Can’t find what you’re looking for? Ask us your question directly and we will get back to you within 24 hours.

What’s the difference between usability testing and benchmarking?

Benchmarking a product is often a long-term process, sometimes stretching over years. A Benchmark study relies heavily on quantitative metrics that are used to compare a product between or against other and/or its own usability, over a period of time.

Usability tests typically output more qualitative data based on behavioural and attitudinal insights, with interview moderators focusing more on probing to uncover the "why" behind a user's decisions.

The two methodologies can be used together or on their own for specific purposes.

Wrapping up a busy year at UX Spot our Research Director, Samuel Jesse was invited on The China Startup Pulse podcast to discuss UX best practices and product localization in China with host Oscar Romas from China Accelerator.

Continue reading

Don’t miss out on future China UX research insights

Subscribe to our e-mail newsletter.

Your data will be safely and securely stored by MailChimp (privacy policy) and only used for the purpose of our newsletter.