Summary
You should not be doing research for the sake of doing research. Research takes time and needs to be well throughout. More importantly, you need to determine if your findings are actually meaningful to the organization. In this session we will look at the idea of statistical significance and meaningfulness when reporting research findings.
Key Insights
-
•
Effective CX research requires a clear alignment with business imperatives and KPIs.
-
•
Statistical significance alone does not guarantee that findings are meaningful to the business.
-
•
Qualitative research provides context and meaning to quantitative data, enriching understanding.
-
•
Competitive benchmarking is essential for assessing relative performance against industry standards.
-
•
Increased sample size doesn’t automatically ensure significance; the context and distribution of data matter.
-
•
Understanding the relationship between statistical significance and meaningfulness is crucial in research interpretation.
-
•
Not all metrics have the same impact on business objectives; prioritizing findings is key.
-
•
Driver modeling is a valuable technique to identify effective perception metrics that influence outcomes.
-
•
CX research should not only measure but also interpret changes in customer sentiment meaningfully.
-
•
Engaging stakeholders by relating findings to their specific interests enhances research impact.
Notable Quotes
"Research is not easy to do; it requires thoughtful planning and execution."
"You don't just want to be doing research for the sake of doing research; it has to have an outcome."
"Qualitative research is extremely important; it gives a clear picture of what the numbers mean."
"Statistical significance does not always correlate with meaningfulness; you need to dive deeper into the data."
"You should not measure more often unless you've made changes that have had time to be adopted."
"Seeing data without context can lead to misinterpretation; it's about understanding what the scores tell you."
"The findings must be relatable to what executives care about, like increasing revenue or reducing costs."
"You should focus on results that are meaningful to your business, not just statistically significant findings."
"Benchmarking your results across different industries is crucial because customers compare experiences beyond your sector."
"Utilizing driver modeling can help determine which metrics are most impactful on your business results."
More Videos
"We are definitely kind of feeling out some phases."
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018
"Each time we communicate, we share in the basic need for human connection."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"The product leadership doesn't see the value in research and they're thinking about shutting the research team down."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"If you feel like there's a lag, we want to know about it."
Bria AlexanderDay 3 Welcome
September 25, 2024
"When you explore lots of different ideas, you're going to understand the context better."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022
"Don’t underestimate the power of storytelling in conveying users’ needs to stakeholders."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021
"The V2Mom framework helps us align our personal and company values effectively."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"If I look around me in a community, some folk are going to be awesome and some are going to be less."
Adrian HowardSturgeon’s Biases
September 25, 2024
"It's important to assume positive intent."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023
