Summary
Data cannot interpret the world. Only humans can. Because of that, the next evolution of AI requires a more collaborative approach to building systems. And UX researchers are uniquely positioned to build the dream team responsible for managing the data collection required for more responsible AI. Anthropology and sociology methodologies provide us the framework to interpret human behavior in a way that telemetry can't. Qualitative research leads to more socially conscious computing decisions that will impact technology companies going forward. Join this fireside conversation to discover... The power of changing one tiny acronym from "Human-Computer Interaction" to "Human-Centered Innovation" Expert recommendations for building more responsible technology What it will take to build a fundamental practice around collecting and analyzing high-quality data Practical steps you can take today to build ethical products in the future
Key Insights
-
•
Jakarta drivers formed self-organized physical base camps replicating workplace communities despite digital platform pressures.
-
•
User-driven innovation, such as hacked apps distributed via WhatsApp, addresses gaps platforms overlook, influencing official feature adoption.
-
•
Technology impacts vary greatly by local context; US-centric assumptions do not hold true globally.
-
•
Qualitative ethnographic research is essential to uncover why and how technology affects communities beyond surface-level metrics.
-
•
Researchers should be reflexive about their own assumptions and power when engaging with communities.
-
•
Early involvement of qualitative research in product development can prevent gap between company assumptions and user needs.
-
•
AI evaluation methods relying solely on automated classifiers risk missing context-specific social meanings and harms.
-
•
Human-in-the-loop evaluation benefits from nuanced research designs considering diverse perspectives and cultural contexts.
-
•
Companies adopting driver base camps acknowledge grassroots knowledge but create exclusion and new social rifts.
-
•
Building trust requires long-term relationship building with communities and local partners, not 'parachute research.'
Notable Quotes
"Drivers continued the practice of hanging out in physical base camp spots despite platforms saying they wanted to get rid of them."
"Users are smart, innovative, and a lot of the innovation actually comes from users rather than big companies."
"Technologies don't have universal impact; what happens in New York vs Jakarta can be very different."
"Sometimes you have to completely change your research questions after building relationships with the community."
"Researchers often treat users as checkboxes, going in, doing research, checking the box and leaving."
"Companies have started building their own base camps, but these feel more exclusionary compared to grassroots ones."
"We shouldn't let the world of computer science make us forget our own power and what we bring to the table."
"It's important not to be a parachute researcher who just jumps in, asks questions, and jumps out without impact."
"Qualitative researchers can help design better human-in-the-loop evaluation guidelines that consider social context."
"Building more ethical, responsible, and humanistic forms of technologies requires diverse and interdisciplinary conversations."
Or choose a question:
More Videos
"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."
Sam ProulxSUS: A System Unusable for Twenty Percent of the Population
December 9, 2021
"You don’t want so much governance that people can’t be creative, but you need just enough to help their process."
Michael LandEstablishing Design Operations in Government
February 18, 2021
"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"People care about titles way too much. I had a guy whose business card said star-bellied sneak—love that."
Ian SwinsonDesigning and Driving UX Careers
June 8, 2016
"The chief of staff can be a natural next step from a design program manager or design ops leader of one."
Isaac HeyveldExpand DesignOps Leadership as a Chief of Staff
September 8, 2022
"Design takes on a new role as governance practitioner, overseeing branding, content, and accessibility."
Amy EvansHow to Create Change
September 25, 2024
"Super strength is the resilience and endurance to partner and drive strategic impact backed by customer obsession."
Kate Koch Prateek KalliFlex Your Super Powers: When a Design Ops Team Scales to Power CX
September 30, 2021
"People don’t share their beliefs; you have to search for and understand them to get true buy-in."
Dave GrayLiminal Thinking: Sense-making for systems in large organizations
May 14, 2015
"Repository to me has a connotation of a place where stuff goes to sit and collect dust."
Matt DuignanAtomizing Research: Trend or Trap
March 30, 2020
