Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
Gold
Thursday, May 14, 2015 • Enterprise UX 2015
Share the love for this talk
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
Speakers: Bill Scott
Link:

Summary

Bill recounts his journey from Netflix, where he witnessed the shift from DVDs to streaming, to PayPal, where he led transformative engineering reforms. At Netflix, he realized that designing software as a throwaway experimentation layer rather than permanent code was key, with multiple concurrent experiments driving user-focused learning. He stresses that engineering should enable learning rather than just code stability. At PayPal, Bill faced legacy technical debt and cultural inertia (organizational antibodies) but pushed for a culture of rapid iteration, collaboration, and customer immersion. He implemented a new technology stack based on Node.js and GitHub, democratized innovation through an internal open source model, and emphasized the need to give Agile a 'brain' by embedding continuous user feedback deeply into the backlog and process. Bill highlights the importance of shared vocabulary between disciplines, collaboration, and continuous customer feedback to keep teams aligned and focused on solving real user problems rather than defending solutions. Drawing on examples from Netflix, PayPal, and Meetup, he underscores that successful teams embrace failure in small increments, enable rapid prototyping, and design for volatility.

Key Insights

  • At Netflix, 95% of the UI layer was thrown away within a year, reframing UI as an experimentation layer rather than durable software.

  • Engineering's primary goal should be enabling learning, partnering closely with design and product teams.

  • Different parts of a software stack have different risk profiles; applying the concept of shearing layers helps accept more risk on the user interface layer to enable faster learning.

  • Organizations contain 'antibodies'—cultural and organizational forces resistant to change—that must be understood and navigated to drive transformation.

  • PayPal's transformation was accelerated by a top-down mandate combined with intense cross-functional collaboration and frequent user testing.

  • Using internal GitHub and open source paradigms democratizes code access and innovation, allowing anyone to contribute and experiment.

  • Prototyping should be considered a first-class engineering activity, not a separate or lesser process.

  • Agile methods lack an inherent ‘brain’; embedding continuous customer feedback and real user context into the backlog gives Agile teams direction and purpose.

  • Engineering teams that share vocabulary and deeply collaborate with designers and product managers produce better outcomes.

  • Embracing small incremental failures enables faster learning and avoids the risk of large-scale failures that can paralyze organizations.

Notable Quotes

"I started thinking of the UI layer as the experimentation layer."

"Engineering’s number one goal should be to enable learning."

"You have to design for throw away ability because the majority of experience gets thrown away."

"Organizations contain antibodies—cultural forces that resist change."

"If you don’t soak teams in real customer context, they do dumb things not because they’re dumb, but because they lack context."

"Features eventually become barnacles that are impossible to scrape off the boat."

"Agile needs a brain, and that brain is the continuous customer feedback loop."

"Prototyping isn’t a second-class citizen, it should be a first-class citizen."

"Democratizing code with an internal open source model accelerates innovation."

"I know I will fail, but I will fail in small increments rather than bet everything and fail big."

Ask the Rosenbot
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
David Sternberg
Uncovering the hidden forces shaping user behavior
2025 • Rosenfeld Community
Peter Van Dijck
Hands on AI #3: Claude Code for UX people
2025 • Rosenfeld Community
Noah Bond
Redefining truth and inclusivity: Navigating data ownership and ethical research in the age of disinformation
2025 • Advancing Research 2025
Gold
Holly Cole
Understanding Experiences: When you have to do more than work
2018 • DesignOps Summit 2018
Gold
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Wendy Johansson
Design at Scale: Behind the Scenes
2021 • Enterprise Community
Fatimah Richmond
The Future of ReOps as a Strategic Function: A Roadmap for Getting There
2024 • Advancing Research 2024
Gold
Adam Thomas
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
2022 • Design in Product 2022
Gold
Mike Oren
Design Research Strategy & Strategic Design Research
2022 • Advancing Research Community
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Greg Petroff
Everything is About to Change: Software as Material
2016 • Enterprise UX 2016
Gold
Kate Towsey
Shaping the future of research ops: Expanding roles and strategies for a more integrated research ecosystem
2025 • Advancing Research 2025
Gold
Ali Jeffery
How DesignOps Helped Enable Wall Street to Work Remotely
2020 • DesignOps Summit 2020
Gold

More Videos

Ned Dwyer

"Research ops was actually there before research at TravelPerk, supporting designers first."

Ned Dwyer Emily Stewart James Wallis

The Intersection of Design and ResearchOps

September 24, 2024

Michael Land

"In government, the org chart really matters – it influences who talks to whom and who gets to interface."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Sam Proulx

"When we design for the edges, we get the middle for free."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

November 18, 2022

Vasileios Xanthopoulos

"A UX partner needs to develop a thick skin when engaging senior VPs and directors."

Vasileios Xanthopoulos

A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale

January 8, 2024

Andrew Custage

"Balance UX and CX—making the site work technically is not enough if the content or experience isn’t meaningful."

Andrew Custage Michael Mallett

The Digital Journey: Research on Consumer Frustration and Loyalty

March 29, 2023

Marjorie Stainback

"Don’t schedule your pilot during the holidays — our first pilot had one graduate because it went through December."

Marjorie Stainback Kelsey Kingman

Transforming Strategic Research Capacity through Democratization

October 24, 2019

Alla Weinberg

"75% of cross-functional teams are dysfunctional because silos perpetuate themselves, even in cross-functional teams."

Alla Weinberg

Cross-Functional Relationship Design

December 6, 2022

Jerome “Axle” Brown

"Change is the only constant, so designing insight sharing with self-directed learning is critical."

Jerome “Axle” Brown

How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon

March 11, 2021

Jen Crim

"The hiring process typically includes two manager screens and a final interview with project presentations."

Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani Pahwa

Culture, DIBS & Recruiting

June 11, 2021