Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Humanizing AI: Filling the Gaps with Multi-faceted Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021

This video is featured in the AI and UX playlist.

Share the love for this talk
Humanizing AI: Filling the Gaps with Multi-faceted Research
Speakers: Joel Branch
Link:

Summary

Artificial intelligence (AI) has graduated from science fiction to commoditized widget form, readily able to snap into many processes of daily life. Hence, enterprises of all maturity levels are increasingly eager to explore AI’s roles in their innovation, or outright survival strategies. Concurrently, ethical and responsible development and execution of AI-based solutions will increasingly become critical for purposes of safety and fairness. Ensuring that AI proliferates along the right path will require the infusion of multi-faceted research activities along the entire AI lifecycle. We will discuss the challenges and opportunities regarding this topic in this presentation.

Key Insights

  • 70% of enterprise AI projects show little to no business impact, and nearly 90% of data science projects fail to reach production.

  • AI bias, particularly intersectional bias in facial recognition, remains a critical unresolved challenge, exemplified by the Gender Shades project.

  • Black-box AI decision-making hinders stakeholder trust and adoption, due to AI’s probabilistic nature and complexity.

  • AI development teams are overly engineer-centric, lacking inclusion of product researchers and ethicists to address societal and user-centered concerns.

  • ML ops, adapted from DevOps, offers governance and accountability frameworks but currently remains engineer-focused.

  • Expanding ML ops to include human-centered researchers can improve AI explainability, trustworthiness, and fairness.

  • Visualization research is essential to analyze and interpret high-dimensional AI data and uncover hidden biases across intersectional subgroups.

  • AI explainability requires moving beyond feature importance towards causal reasoning and natural language explanations accessible to non-technical stakeholders.

  • AI trust is evolving and hinges on AI’s ability to provide convincing, interpretable answers that humans can understand and scrutinize in dialogue form.

  • Humanizing AI is not simply building human-like interfaces but creating governance frameworks that democratize responsible AI development.

Notable Quotes

"AI development is often uninformed and hurried, resulting in deployments that don’t operate well in the real world."

"Humanizing AI means creating governance frameworks that involve a broad array of research competencies for democratizing safe and effective AI."

"Almost 90% of data science projects do not make it into production—they die on the vine."

"Black box decision making is a hallmark problem—information goes in, something comes out, but we have no clue why."

"Bias is fueled by over-engineering without enough participation from non-technical roles that could reduce it."

"The Gender Shades project exposed how facial recognition algorithms had up to a 33% error rate disparity between demographic groups."

"ML ops offers governance, accountability, and a clear stakeholder responsibility framework borrowed from DevOps."

"We want to increase trust and engagement among end users by helping non-technical stakeholders participate in model evaluation."

"Explainability metrics like trustworthiness and understandability are hard, open research problems needing AI-HCI collaboration."

"AI trust will grow when AI can provide back-and-forth justifications like a human would in conversation."

Ask the Rosenbot
Reginé Gilbert
Asking the Right Questions: Life, Hope and Moving Forward During the Pandemic
2022 • Design at Scale 2022
Gold
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization
2020 • Enterprise Community
Shan Shen
Translating UX Terms into Business Contexts
2023 • Design in Product 2023
Gold
Louis Rosenfeld
Opening Remarks
2023 • Advancing Research 2023
Gold
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Nora Tejeda
Scaling Design Capabilities at BBVA Through a Self-service Design Model
2021 • Design at Scale 2021
Gold
Maria Taylor
Knowledge is Power: Managing the Lifeblood of the Design Org
2023 • DesignOps Summit 2023
Gold
Amelia Cole
Data-Prompted Interviews
2021 • QuantQual Interest Group
Jodi Forlizzi
Design and AI innovation
2024 • Designing with AI 2024
Gold
Matt Webb
Context Window: Five Futures for AI
2025 • Designing with AI 2025
Gold
Tess Dixon
C'mon Get Happy
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Patrizia Bertini
Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
2025 • DesignOps Community
Maria Giudice
Remaking the Making Company: Moving from Product to Experience
2016 • Enterprise UX 2016
Gold

More Videos

Mariah Hay

"Engineers receive an iron ring to remind them of their fallibility and ethical responsibility to society."

Mariah Hay

Ethics in Tech Education: Designing to Provide Opportunity for All

June 14, 2018

Dave Hora

"Working with complexity requires maintaining ambiguity as long as possible before converging on action."

Dave Hora

Research in the Face of Complexity: New Sensibility for New Situations

August 27, 2025

Sean McKay

"If you give up, we all give up."

Sean McKay

Coexisting with non-researchers: Practical strategies for a democratized research future

March 11, 2025

Malini Rao

"Re-platforming is transformative not just for the product but also for the people, teams, and organization."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Sam Proulx

"VoiceOver gestures like swipe right move the focus through elements; double tap activates them."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

October 2, 2023

Bud Caddell

"Sometimes you’re just laying the foundational bricks so an idea or process can get off the ground."

Bud Caddell Kristin Skinner Alana Washington

DesignOps Community Sensing Session

May 13, 2021

Michaela Mora

"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."

Michaela Mora

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions

March 11, 2022

John Donmoyer

"Throwing away old methods for something new can unlock skills you didn’t know you had."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Chris Geison

"There's no better time to advance research than now."

Chris Geison

Theme Two Intro

March 28, 2023