Summary
Data cannot interpret the world. Only humans can. Because of that, the next evolution of AI requires a more collaborative approach to building systems. And UX researchers are uniquely positioned to build the dream team responsible for managing the data collection required for more responsible AI. Anthropology and sociology methodologies provide us the framework to interpret human behavior in a way that telemetry can't. Qualitative research leads to more socially conscious computing decisions that will impact technology companies going forward. Join this fireside conversation to discover... The power of changing one tiny acronym from "Human-Computer Interaction" to "Human-Centered Innovation" Expert recommendations for building more responsible technology What it will take to build a fundamental practice around collecting and analyzing high-quality data Practical steps you can take today to build ethical products in the future
Key Insights
-
•
Jakarta drivers formed self-organized physical base camps replicating workplace communities despite digital platform pressures.
-
•
User-driven innovation, such as hacked apps distributed via WhatsApp, addresses gaps platforms overlook, influencing official feature adoption.
-
•
Technology impacts vary greatly by local context; US-centric assumptions do not hold true globally.
-
•
Qualitative ethnographic research is essential to uncover why and how technology affects communities beyond surface-level metrics.
-
•
Researchers should be reflexive about their own assumptions and power when engaging with communities.
-
•
Early involvement of qualitative research in product development can prevent gap between company assumptions and user needs.
-
•
AI evaluation methods relying solely on automated classifiers risk missing context-specific social meanings and harms.
-
•
Human-in-the-loop evaluation benefits from nuanced research designs considering diverse perspectives and cultural contexts.
-
•
Companies adopting driver base camps acknowledge grassroots knowledge but create exclusion and new social rifts.
-
•
Building trust requires long-term relationship building with communities and local partners, not 'parachute research.'
Notable Quotes
"Drivers continued the practice of hanging out in physical base camp spots despite platforms saying they wanted to get rid of them."
"Users are smart, innovative, and a lot of the innovation actually comes from users rather than big companies."
"Technologies don't have universal impact; what happens in New York vs Jakarta can be very different."
"Sometimes you have to completely change your research questions after building relationships with the community."
"Researchers often treat users as checkboxes, going in, doing research, checking the box and leaving."
"Companies have started building their own base camps, but these feel more exclusionary compared to grassroots ones."
"We shouldn't let the world of computer science make us forget our own power and what we bring to the table."
"It's important not to be a parachute researcher who just jumps in, asks questions, and jumps out without impact."
"Qualitative researchers can help design better human-in-the-loop evaluation guidelines that consider social context."
"Building more ethical, responsible, and humanistic forms of technologies requires diverse and interdisciplinary conversations."
Or choose a question:
More Videos
"We made this move in January 2020 — our research and insights team moved out of UX but stayed within product organizations."
Nalini KotamrajuResearch After UX
March 25, 2024
"Not belonging anywhere meant that I had access everywhere."
Dean BroadleyNot Black Enough to be White
January 8, 2024
"If you’re not doing the work of addressing your own pain, you won’t be effective in helping others."
Denise Jacobs Nancy Douyon Renee Reid Lisa WelchmanInteractive Keynote: Social Change by Design
January 8, 2024
"Reporting progress with data and stories opens up opportunities with stakeholders and builds credibility."
Kim Fellman CohenMeasuring the Designer Experience
October 23, 2019
"Why do designers decide how to design this? How do we wean design's addiction from whiteness?"
George AyeThat Quiet Little Voice: When Design and Ethics Collide
November 16, 2022
"Short-term pairings with different design people help bring back contributions into the central system."
Nathan CurtisBeyond the Toolkit: Spreading a System Across People & Products
June 9, 2016
"We want our culture to be about the outcome, not about who owns what or who’s doing what on a piece of work."
Greg PetroffThe Compass Mission
March 10, 2021
"Traditional design thinking and human-centered design rarely take localized nuances and global trends into account."
Chloe Amos-EdkinsA Cultural Approach: Research in the Context of Glocalisation
March 27, 2023
"Some stakeholders still prefer their beliefs to data, even in academia."
Mackenzie Cockram Sara Branco Cunha Ian FranklinIntegrating Qualitative and Quantitative Research from Discovery to Live
December 16, 2022
