Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Broad Strokes: Connecting Design, Research, and AI to the World Around Us
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Broad Strokes: Connecting Design, Research, and AI to the World Around Us
Speakers: Dr. Jamika D. Burge
Link:

Summary

AI-based modeling plays an ever-increasing role in our daily lives. Our personal data and preferences are being used to build models that serve up anything from movie recommendations to medical services with a precision designed to make life decisions easier. But, what happens when those models are not precise enough or are unusable because of incomplete data, incorrect interpretations, or questionable ethics? What's more, how do we reconcile the dynamic and iterative nature of AI models (which are developed by a few) with the expansive nature of the human experience (which is defined by many) so that we optimize and scale UX for AI applications equitably? This talk will push our understanding of the sociotechnical systems that surround AI technologies, including those developing the models (i.e., model creators) and those for whom the models are created (i.e., model customers). What considerations should we keep top of mind? How might the research practice evolve to help us critique and deliver inclusive and responsible AI systems?

Key Insights

  • AI systems can unintentionally amplify racial biases in healthcare and hiring processes.

  • The healthcare system's reliance on algorithmic scoring can disproportionately harm Black and Hispanic patients.

  • Historically biased training data leads AI algorithms to favor certain demographic groups, perpetuating inequality.

  • Dark patterns in UX design can mislead users, taking advantage of their trust and leading to uninformed decision-making.

  • Deep fakes pose a significant threat by distorting facts, misrepresenting people, and potentially influencing democratic processes.

  • Human biases can still affect AI outputs despite the technology's reliance on structured data.

  • Research shows that job candidates often distrust AI in hiring decisions over human judgment.

  • There is a lack of comprehensive research into the implications of AI bias in hiring practices.

  • The history of unethical research, like the Tuskegee study, underscores the need for human subject protections in technology.

  • Ethics must be a core consideration in UX research and AI system design to prevent harm.

Notable Quotes

"We have a multitude of data points and factors that go into how our AI models are crafted."

"Racially correlated health data has become commonplace and clinical algorithms that adjust for race aren't very helpful."

"The intention behind implementing AI in hiring processes is often to increase efficiency and objectivity but these systems can inadvertently perpetuate bias."

"Dark patterns make it difficult for people to make the right decisions, leading to exploitation."

"Facial recognition software can lead to false arrests because algorithms can't distinguish between black faces."

"There's more to biases in AI than what's immediately visible; akin to an iceberg."

"Ethical mishandling in research informs the creation of institutional review boards to protect participants."

"We must ensure appropriate representation of consumer experiences when designing AI systems."

"It's our responsibility as researchers to do no harm and to raise alarms when necessary."

"Asking the right questions can transform the work in ways that otherwise would not be possible."

More Videos

Noz Urbina

"When I say journey maps, I do not mean this for me is a big no; I hate these things."

Noz Urbina

Rapid AI-powered UX (RAUX): A framework for empowering human designers

May 1, 2025

Jim Kalbach

"Not just making things up here on stage; there's actually an underlying structure."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

June 4, 2019

Holly Cole

"I want to talk to you about are you really doing user-centered teamwork when you're thinking about growing a team."

Holly Cole

Understanding Experiences: When you have to do more than work

November 8, 2018

Jack Behar

"You will receive an email or follow-up survey, but you will have the option to sign up for a workshop."

Jack Behar

How to Build Prototypes that Behave like an End-Product

December 6, 2022

Bria Alexander

"We are still a community, and we are obligated to treat each other with kindness and respect."

Bria Alexander

Opening Remarks

October 3, 2023

Erika Flowers

"Lean into hope; it's the only thing that drives conversations forward in AI."

Erika Flowers

AI-Readiness: Preparing NASA for a Data-Driven, Agile Future

June 10, 2025

Kristin Skinner

"Equipped with the right tools, we can truly meet students where they are."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Jim Kalbach

"How can a group of people come together and spontaneously create something that is legendary?"

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

November 6, 2017

Surya Vanka

"Embrace diversity to unleash creative power in organizations."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021