The Methods UX Professionals Use (2024)
User experience research has a wide variety of methods. The variety can be both inspiring and daunting—where do you start, what should you master?| MeasuringU
User experience research has a wide variety of methods. The variety can be both inspiring and daunting—where do you start, what should you master?| MeasuringU
AI is rapidly changing. By the time we write about the latest features and performance benchmarks, they are replaced by newer features and benchmarks. But are all those features and benchmarks noticed by users? Perhaps. The speed of change in AI shouldn’t stop us from taking a snapshot of the user experience. Even with rapidly […]| MeasuringU
We developed the SUPR-Qm® in 2017 to measure the quality of the mobile app experience. Its original form had 16 items. That is long for a UX questionnaire (e.g., the SUS has ten and the SUPR-Q® has eight). The reason it had 16 items was that it was developed using a technique called Rasch analysis, […]| MeasuringU
Pets aren’t just family; they’re big business. The expectation for the U.S. is that owners will spend a total of $157 billion by the end of 2025 and will spend close to $200 billion in 2030. In 2024, U.S. pet owners spent over $28 billion buying pet food and supplies online (up 2.6% year-over-year), with […]| MeasuringU
What should you do when your sample doesn’t match the known population composition on key variables like prior experience? One approach is to weight your data to rebalance the sample. In a previous article, we discussed how to weight means (such as from rating scales) when there are differences between group proportions in a sample […]| MeasuringU
The word “standardized” conjures memories of high-stakes tests. In the context of UX research, when we talk of standardization, we’re often referring to standardized questionnaires. Standardized questionnaires have gone through the process of psychometric validation. That means the items being used have gone through dozens or hundreds of possible variations, and the final versions are […]| MeasuringU
We know that for a lot of UX professionals, quantitative UX research sounds like an oxymoron. You might have been involved in a few debates that included topics like: Whether you should even use numbers in UX research Which is the best UX metric to use Whether you’re using the right statistical test on your […]| MeasuringU
Mobile apps are different from websites. People have different expectations for a mobile app and how it can integrate with their phone and data. While the mobile app experience is similar in many ways to other interfaces such as websites and software, mobile apps are distinct enough that we feel they deserve their own questionnaire. […]| MeasuringU
“What sample size do I need?” We’ve all been trained from years of math education to expect a single answer to that question—a single sample size number. But earlier, we warned against the quixotic quest to identify the one true sample size to use for UX research—the “magic number.” Because sampling error is real but […]| MeasuringU
Yes, of course you can.| measuringu.com
Did the student write the paper with AI? Did the teacher review the paper with AI? Did the respondent use AI to answer the survey? Did the researcher use AI to detect responses that were AI generated? Was this article written with AI? Was the LinkedIn post about this article written with AI? There’s hardly […]| MeasuringU
In an earlier article, we examined a large dataset of rating scale data. After analyzing over 100,000 individual responses from 4,048 multipoint items across 25 studies, we reported the typical standard deviations for five-, seven-, and eleven-point items.| measuringu.com
The standard deviation is the most common measure of variability. It’s less intuitive than measures of central tendency such as the mean, but it plays an essential role in analysis and sample size planning.| MeasuringU
When working with UX metrics (e.g., rating scale data) you need to consider both the average and the variability of the responses.| MeasuringU
Online panel research has been a boon for market research and UX researchers alike.| MeasuringU
Continuing a decades-long tradition, in 2024 we worked with the UXPA to collect and understand the UX profession’s latest compensation, skills, and composition.| MeasuringU
Is not recommending the same as discouraging or recommending others to not use or purchase from a brand?| MeasuringU
Clutter distracts and detracts from a good user experience.| MeasuringU
Poor layout, irrelevant ads, overwhelming videos: websites can be cluttered.| MeasuringU
After users attempt a task, ask them this simple question: Overall, how difficult or easy was the task to complete? Use the seven point rating scale format below.| MeasuringU
Sample size estimation is an important part of study planning. If the sample size is too small, the study will be underpowered, meaning it will be incapable of detecting sufficiently small differences as statistically significant. If the sample size is too large, the study will be inefficient and cost more than necessary.| MeasuringU
When we speak about a qualitative research study, it’s easy to think there is one kind.| MeasuringU
In math class, we spend a lot of time learning fractions because they are so important in everyday life (e.g., budgeting, purchasing at the grocery store). Fractions are also used extensively in UX research (e.g., the fundamental completion rate is a fraction), typically expressed as percentages or proportions. Unfortunately, fractions are also hard to learn, and as it turns out, they are not the easiest to statistically analyze.| MeasuringU
