Rosenverse
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Lean Engineering: Engineering for Learning and Experimentation in the Enterprise

Gold
Thursday, May 14, 2015 • Enterprise UX 2015
Share the love for this talk
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
Speakers: Bill Scott
Link:

Summary

Bill recounts his journey from Netflix, where he witnessed the shift from DVDs to streaming, to PayPal, where he led transformative engineering reforms. At Netflix, he realized that designing software as a throwaway experimentation layer rather than permanent code was key, with multiple concurrent experiments driving user-focused learning. He stresses that engineering should enable learning rather than just code stability. At PayPal, Bill faced legacy technical debt and cultural inertia (organizational antibodies) but pushed for a culture of rapid iteration, collaboration, and customer immersion. He implemented a new technology stack based on Node.js and GitHub, democratized innovation through an internal open source model, and emphasized the need to give Agile a 'brain' by embedding continuous user feedback deeply into the backlog and process. Bill highlights the importance of shared vocabulary between disciplines, collaboration, and continuous customer feedback to keep teams aligned and focused on solving real user problems rather than defending solutions. Drawing on examples from Netflix, PayPal, and Meetup, he underscores that successful teams embrace failure in small increments, enable rapid prototyping, and design for volatility.

Key Insights

  • •

    At Netflix, 95% of the UI layer was thrown away within a year, reframing UI as an experimentation layer rather than durable software.

  • •

    Engineering's primary goal should be enabling learning, partnering closely with design and product teams.

  • •

    Different parts of a software stack have different risk profiles; applying the concept of shearing layers helps accept more risk on the user interface layer to enable faster learning.

  • •

    Organizations contain 'antibodies'—cultural and organizational forces resistant to change—that must be understood and navigated to drive transformation.

  • •

    PayPal's transformation was accelerated by a top-down mandate combined with intense cross-functional collaboration and frequent user testing.

  • •

    Using internal GitHub and open source paradigms democratizes code access and innovation, allowing anyone to contribute and experiment.

  • •

    Prototyping should be considered a first-class engineering activity, not a separate or lesser process.

  • •

    Agile methods lack an inherent ‘brain’; embedding continuous customer feedback and real user context into the backlog gives Agile teams direction and purpose.

  • •

    Engineering teams that share vocabulary and deeply collaborate with designers and product managers produce better outcomes.

  • •

    Embracing small incremental failures enables faster learning and avoids the risk of large-scale failures that can paralyze organizations.

Notable Quotes

"I started thinking of the UI layer as the experimentation layer."

"Engineering’s number one goal should be to enable learning."

"You have to design for throw away ability because the majority of experience gets thrown away."

"Organizations contain antibodies—cultural forces that resist change."

"If you don’t soak teams in real customer context, they do dumb things not because they’re dumb, but because they lack context."

"Features eventually become barnacles that are impossible to scrape off the boat."

"Agile needs a brain, and that brain is the continuous customer feedback loop."

"Prototyping isn’t a second-class citizen, it should be a first-class citizen."

"Democratizing code with an internal open source model accelerates innovation."

"I know I will fail, but I will fail in small increments rather than bet everything and fail big."

Ask the Rosenbot
Patrizia Bertini
DesignOps + KPIs = Measure your Impact!
2024 • DesignOps Summit 2020
Gold
Simon Wardley
Maps and Topographical Intelligence
2019 • Enterprise Community
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Vitorio Miliano
Don’t call it AI: Turn words into numbers with quantitative ethnography
2026 • Advancing Research 2026
Gold
Peter Van Dijck
Hands-on AI #1: Let’s write your first AI eval
2025 • Rosenfeld Community
Cennydd Bowles
Exit Interview #2: Rediscovering the ethical heart of design
2025 • Rosenfeld Community
Saara Kamppari-Miller
Theme Three Intro
2023 • DesignOps Summit 2023
Gold
Greg Baker
Exploring What Decades of Expertise Can Do Outside a Traditional Tech Role
2026 • Rosenfeld Community
John Cutler
Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
2024 • Advancing Service Design 2024
Gold
Frances Yllana
Theme 2 Intro
2024 • DesignOps Summit 2024
Gold
Craig Villamor
Design Systems for Ethical Design
2023 • Enterprise Community
Kate Towsey
Shaping the future of research ops: Expanding roles and strategies for a more integrated research ecosystem
2025 • Advancing Research 2025
Gold
Jen Cardello
Learning Velocity—The Insights Speedometer
2021 • Advancing Research Community
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold

More Videos

Matt LeMay

"You don’t get anyone to do anything."

Matt LeMay

You Don’t “Get” Anyone to Do Anything

December 6, 2022

Phil Gilbert

"We could create a sustainable culture of design and use it as our leading edge weapon of transformation."

Phil Gilbert

A Consistent Culture of Design

May 14, 2015

Louis Rosenfeld

"Enterprise UX is about delivering strong experiences in an enterprise setting, which ain’t easy."

Louis Rosenfeld

Welcome / Housekeeping

June 6, 2023

Rachael Dietkus, LCSW

"Research should prioritize participant and researcher well-being over institutional convenience."

Rachael Dietkus, LCSW

The power to heal and harm

March 13, 2025

Jake Burghardt

"Stop Wasting Research is really about thinking about research at scale and providing a big menu of different directions to try."

Jake Burghardt

Finding More Inroads into Research Impact

February 20, 2026

Fatimah Richmond

"Design leaders with shared ownership at the C-suite table impact revenue and product research significantly."

Fatimah Richmond

The Future of ReOps as a Strategic Function: A Roadmap for Getting There

March 25, 2024

Joshua Graves

"If you don't speak up about ludicrous requests, someone will ask why you didn’t say anything."

Joshua Graves

We Need To Talk: Managing Ludicrous Requests at Work (Part 3 of 3)

May 12, 2025

Joshua Graves

"You need to know your limits on how far you’re willing to exert influence and your energy investment."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Harry Max

"I’ve become a subversive designer because I’m now considered a product leader using prioritization at the organizational level."

Harry Max

Priority Zero: Some Things are More Equal than Others

June 9, 2016