10k Screens Later: How We Became a Data-Driven Design Organization
Summary
In this session, we'll explore how a small UI design firm (30 headcount) developed a data-driven DesignOps practice. I'll demonstrate how we use automation and robust data pipelines to excel in managing and delivering large volumes of work. This talk also shows how we transform Figma’s comment feature into a powerful tool that integrates seamlessly with Trello, enabling our team to achieve high efficiency and precision, and to track everything in real-time without the usual administrative and logistical challenges. Automation and Custom Tooling: We leverage automation to ensure every process, from capturing to moving work, is streamlined and efficient. This approach helps us tackle the scalability of thousands of work cards without overwhelming our team. Data-Driven with a Soul: This talk addresses concerns around micromanagement and surveillance, illustrating how our methods support consistent delivery (with 95% confidence) without sacrificing the human aspect of our work.
Key Insights
-
•
Frost Design Group achieved 95% accuracy in forecasting delivery dates using team performance data despite volatile project conditions.
-
•
They replaced traditional two-week sprints with a Kanban continuous delivery approach, better suiting their workflow.
-
•
Figma comment boxes were transformed into a tracking system with AI that automatically creates and categorizes work cards, reducing manual admin time drastically.
-
•
Monte Carlo simulations are used to forecast project delivery probabilities, enabling data-driven decision making and avoiding guesswork in estimations.
-
•
Tracking cycle time by production stage helps identify bottlenecks and informs resource allocation, improving workload balance.
-
•
Data-driven insights justified front-loading resources and demonstrated a 49% increase in delivery volume in one financial year segment.
-
•
They measure designer productivity by combining output and time data, avoiding both quantity over quality bias and purely hours-based assessment.
-
•
Interventions based on performance data helped junior designer Leia improve output by 364% year-over-year, leading to promotion and mentoring responsibilities.
-
•
Automations reduced unnecessary manual work by 2 hours daily for lead designer Dawn, showing the importance of streamlining non-design tasks.
-
•
Their design operations team expanded from one to three roles, separating responsibilities across work pipeline, team quality, and client commitments.
Notable Quotes
"We can forecast delivery dates despite shifting and volatile project conditions with 95% efficiency."
"Our file is a visual representation of our entire workflow and mirrors the structure of our board."
"Tracking and capturing the work can be a whole new work in itself. People will naturally abandon complicated process."
"We replaced the exhausting time estimation game with data-driven models that give us more reliable results."
"Spending more time doesn’t automatically make you productive, it just means you spent more time doing things."
"Data is supposed to be neutral. It’s the way one uses it that can bring good or bad outcomes."
"We use this data not to dehumanize, but to elevate each person’s uniqueness and fairly incentivize performance."
"Design is really a team sport. Everyone is responsible to keep the workspace up to date."
"Being design-driven is a means to an end. We aim to be 1% better every day with data-driven obsession."
"Our mission is to raise the overall value of design in the Philippines where it’s often seen as an expense item."
Or choose a question:
More Videos
"It’s about us, the design ops practitioners, and what we need today to be better at our jobs."
Bria AlexanderTheme Two Intro
October 3, 2023
"On days with many user interviews, the team wanted internal meetings video off to take a break from 'smiling all day.'"
Ariba JahanTeam Resiliency Through a Pandemic
January 8, 2024
"Many big companies now have roles related to ecosystem design like VP or senior managers of ecosystem."
Cornelius RachieruHandling Complexity: Framing a Scale of Design
June 9, 2021
"WCAG does not apply to native mobile apps, which is how slow progress can be on this topic."
Megan Clegg Michael Haggerty-Villa Alexis MorinSpace for Everyone: Reframing Accessibility Through a Wider Lens
June 10, 2021
"Map tours are my favorite thing—taking a new hire on a guided walk of the entire community."
Saara Kamppari-MillerCartography for Design Communities
September 10, 2025
"Civic design and government design practice have reached many milestones in the past 10 years."
Kara KaneTheme One Intro
November 16, 2022
"Producers create a care plan for every project — they’re far more than project managers."
Natalia RadywylCo-Designing New Power in Australia's Public Sector
November 16, 2022
"We Westerners are designing for ourselves without realizing it, feeding back into a loop of luxury products."
Nancy DouyonWe'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
June 15, 2018
"We invented the ‘prompt deep dive’ technique to spend lots of time on one prompt to deeply understand it."
Peter Van DijckBuilding the Rosenbot
June 4, 2024
Latest Books All books
Dig deeper with the Rosenbot
How can large teams coordinate AI adoption without causing confusion and duplicated work?
What skills are essential for designers to communicate effectively with AI to achieve meaningful outputs?
What new workflows or tools have been effective in bridging the gap between design, engineering, and product teams using AI?