Rosenverse
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Speakers: Marisa Bernstein
Link:

Summary

While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful.

Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.

Key Insights

  • •

    Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.

  • •

    Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.

  • •

    Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.

  • •

    Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.

  • •

    Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.

  • •

    Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.

  • •

    Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.

  • •

    Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.

  • •

    Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.

  • •

    Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.

Notable Quotes

"If it doesn’t work for you, it doesn’t work."

"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."

"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."

"Participant experience is everything and it starts with building trust."

"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."

"Use plain language in all communication. No design or technology jargon."

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."

Ask the Rosenbot
Saara Kamppari-Miller
DesignOps for Inclusive Design and Accessibility
2022 • DesignOps Community
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Kara Kane
Communities of Practice for Civic Design
2022 • Civic Design Community
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Robert Schwartz
We're Here for the Humans
2017 • Enterprise Experience 2017
Gold
Sofía Delsordo
Public Policy for Jalisco's Designers to Make Design Matter
2021 • Civic Design 2021
Gold
Maggie Dieringer
Cutting through the Noise
2020 • DesignOps Community
Katy Mogal
But Do Your Insights Scale?
2021 • Advancing Research 2021
Gold
Jesse Zolna
Inviting the Whole Org to Come See For Yourself
2020 • Advancing Research 2020
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Davis Neable
How to Drive a Design Project When you Don’t Have a Design Team
2021 • Design at Scale 2021
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2017 • DesignOps Summit 2017
Gold
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold

More Videos

Dr. Karl Jeffries

"An elite athlete doesn’t turn up at the Olympics and do their thing without coaches, physios, nutritionists."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"I never want to walk into a review with my stakeholders at the SVP level and see something for the first time."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Trust is built by showing you’re there to help make them succeed, not just push your agenda."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"Constant communication is necessary; agreement emails can’t be one-and-done."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"Puppetry lets you communicate like, I don’t like what you said, how come you said that to me."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"You can’t really advocate for UX or move an organization forward without interacting with your team and business colleagues."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"Data entry is the enemy; automation is the key to making research repositories successful."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"If you think innovation can happen without buy-in from the CEO, I would love to see that; I have not seen it work."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"Marketing is an essential collaborator because they help package and communicate insights organization-wide."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books