Rosenverse
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Speakers: Marisa Bernstein
Link:

Summary

While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful.

Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.

Key Insights

  • •

    Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.

  • •

    Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.

  • •

    Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.

  • •

    Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.

  • •

    Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.

  • •

    Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.

  • •

    Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.

  • •

    Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.

  • •

    Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.

  • •

    Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.

Notable Quotes

"If it doesn’t work for you, it doesn’t work."

"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."

"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."

"Participant experience is everything and it starts with building trust."

"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."

"Use plain language in all communication. No design or technology jargon."

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."

Ask the Rosenbot
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Weidan Li
Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • DesignOps Summit 2023
Gold
Shipra Kayan
Make your research synthesis speedy and more collaborative using a canvas
2025 • Rosenfeld Community
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Jesse James Garrett
Ready, Steady, Go! Making the Shift to What Comes Next
2026 • Shift UX 2026
Conference
Christian Crumlish
Teaching My Agents to Disagree With Me
2026 • Rosenfeld Community
Katie Hansen
Experimental research: techniques for deep, psychology-driven insights
2025 • Advancing Research 2025
Gold
Dianne Que
Real Talk: Proving Value through a Scrappy Playbook
2019 • DesignOps Summit 2019
Gold
You’ve got Gold! A Rosenverse demo with Lou Rosenfeld
2026 • Rosenfeld Community
Aleksandra Korczynska
Survey Tools
2026 • Advancing Research 2026
Gold
Snehal Pendharkar
Conducting pre-research with AI agent personas: Pressure-testing concepts for expert workflows
2026 • Designing with AI 2026
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold

More Videos

Nancy Douyon

"We Westerners are designing for ourselves without realizing it, feeding back into a loop of luxury products."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Jack Behar

"You can’t just break apart these components and type; instead, you change their properties to adjust labels, colors, or icons."

Jack Behar

How to Build Prototypes that Behave like an End-Product

December 6, 2022

Jorge Arango

"Culture eats strategy for breakfast—integrating cultures is the hardest and most critical part of mergers."

Jorge Arango

Meeting of the Waters: Designing for Successful Inorganic Growth

August 12, 2021

Jon White

"No more than five key insights — any more and teams start going off in different directions."

Jon White Erin May

Unsticking Research for Better Information Flow

March 11, 2026

Jessamyn Edwards

"Tracking complaints and fixing things immediately, even if it’s just one person, is a mark of good UX impact."

Jessamyn Edwards

Surviving Your UX Career in Enterprise Design

December 2, 2021

Stefanie Owens

"Injecting a culture of agile iteration sets the precedent that things can and will change as the team learns."

Stefanie Owens

Optimizing for Outcomes: Transformation Design in Systems at Scale

December 4, 2024

Ron Bronson

"Attention theft is when experiences are designed to siphon away your focus aggressively."

Ron Bronson

Design, Consequences & Everyday Life

November 18, 2022

Louis Rosenfeld

"Imagine a world where research bots at IBM talk to the Rosen bot to give you better guidance on interpreting research."

Louis Rosenfeld

The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld

June 5, 2024

Ash Brown

"We're at a pivotal moment where technology can truly make a difference in sustainability."

Ash Brown

Silver Linings: What DesignOps Learned in the Shift to WFH

October 23, 2020

Latest Books All books