Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
Gold
Thursday, May 14, 2015 • Enterprise UX 2015
Share the love for this talk
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
Speakers: Bill Scott
Link:

Summary

Bill recounts his journey from Netflix, where he witnessed the shift from DVDs to streaming, to PayPal, where he led transformative engineering reforms. At Netflix, he realized that designing software as a throwaway experimentation layer rather than permanent code was key, with multiple concurrent experiments driving user-focused learning. He stresses that engineering should enable learning rather than just code stability. At PayPal, Bill faced legacy technical debt and cultural inertia (organizational antibodies) but pushed for a culture of rapid iteration, collaboration, and customer immersion. He implemented a new technology stack based on Node.js and GitHub, democratized innovation through an internal open source model, and emphasized the need to give Agile a 'brain' by embedding continuous user feedback deeply into the backlog and process. Bill highlights the importance of shared vocabulary between disciplines, collaboration, and continuous customer feedback to keep teams aligned and focused on solving real user problems rather than defending solutions. Drawing on examples from Netflix, PayPal, and Meetup, he underscores that successful teams embrace failure in small increments, enable rapid prototyping, and design for volatility.

Key Insights

  • At Netflix, 95% of the UI layer was thrown away within a year, reframing UI as an experimentation layer rather than durable software.

  • Engineering's primary goal should be enabling learning, partnering closely with design and product teams.

  • Different parts of a software stack have different risk profiles; applying the concept of shearing layers helps accept more risk on the user interface layer to enable faster learning.

  • Organizations contain 'antibodies'—cultural and organizational forces resistant to change—that must be understood and navigated to drive transformation.

  • PayPal's transformation was accelerated by a top-down mandate combined with intense cross-functional collaboration and frequent user testing.

  • Using internal GitHub and open source paradigms democratizes code access and innovation, allowing anyone to contribute and experiment.

  • Prototyping should be considered a first-class engineering activity, not a separate or lesser process.

  • Agile methods lack an inherent ‘brain’; embedding continuous customer feedback and real user context into the backlog gives Agile teams direction and purpose.

  • Engineering teams that share vocabulary and deeply collaborate with designers and product managers produce better outcomes.

  • Embracing small incremental failures enables faster learning and avoids the risk of large-scale failures that can paralyze organizations.

Notable Quotes

"I started thinking of the UI layer as the experimentation layer."

"Engineering’s number one goal should be to enable learning."

"You have to design for throw away ability because the majority of experience gets thrown away."

"Organizations contain antibodies—cultural forces that resist change."

"If you don’t soak teams in real customer context, they do dumb things not because they’re dumb, but because they lack context."

"Features eventually become barnacles that are impossible to scrape off the boat."

"Agile needs a brain, and that brain is the continuous customer feedback loop."

"Prototyping isn’t a second-class citizen, it should be a first-class citizen."

"Democratizing code with an internal open source model accelerates innovation."

"I know I will fail, but I will fail in small increments rather than bet everything and fail big."

Alexandra Schmidt
Enterprise UX Playbook
2022 • Enterprise Community
Sarah Auslander
Insights Panel
2022 • Civic Design 2022
Gold
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Louis Rosenfeld
Discussion: What Operations can teach DesignOps
2017 • DesignOps Summit 2017
Gold
Jon Fukuda
Design Planning and Management Support
2023 • DesignOps Summit 2023
Gold
Kaaren Hanson
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Meredith Black
Scaling Design Culture
2017 • DesignOps Summit 2017
Gold
David Cronin
Discussion
2015 • Enterprise UX 2015
Gold
Christian Rohrer
Insight Types That Influence Enterprise Decision Makers
2015 • Enterprise UX 2015
Gold
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Kate Towsey
The State of ResearchOps: More Than Just Theory
2019 • DesignOps Community
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Nathan Shedroff
Redefining Value: Bridging the Innovation Culture Divide
2015 • Enterprise UX 2015
Gold
Karen Pascoe
Developing Experience Teams and Talent in the Enterprise
2016 • Enterprise UX 2016
Gold
Satyam Kantamneni
Do You Have an Experience Vision?
2023 • Enterprise Community
John Taschek
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold

More Videos

Etienne Fang

"Uber bus drivers in Cairo end up working longer than their scheduled shift because they still receive requests 20 to 30 minutes before their shift ends."

Etienne Fang

Power of Insights: Why sharing is better than silos with Uber’s Insights Platform

December 16, 2019

Victor M. Gonzalez

"Doing work in one-week cycles fits the rhythms of companies working with agile and Scrum frameworks."

Victor M. Gonzalez

Practicing Learners and Learning Practitioners

March 10, 2021

Roberta Dombrowski

"Research typically is actually a group endeavor and is most effective when done collaboratively."

Roberta Dombrowski Sam Duong Woloszynski

Making Research a Team Sport

March 11, 2022

Daniel J. Rosenberg

"BlueStar lowered users' A1C by 2 points, outperforming the most common drug metformin which averages 1.5."

Daniel J. Rosenberg

Digital Medicine Design

September 26, 2019

Jaime Creixems

"Design system is basically an agreement that helps create a sense of consistency and familiarity in all the UIs that you create."

Jaime Creixems

Best Practices when Creating and Maintaining a Design System

June 7, 2023

Tricia Wang

"Our job is to fight context loss as data moves up layers of abstraction in AI outputs."

Tricia Wang

From Users to Shapers of AI: The Future of Research

March 25, 2024

Shahrzad Samadzadeh

"Designers create value by making artifacts and experiences before fully understanding the space."

Shahrzad Samadzadeh

What Is My Value? Two Takes and Some Mistakes

January 8, 2024

Jorge Arango

"The challenge for us is how might we act more skillfully under conditions of VUCA."

Jorge Arango

Design as an Antidote to VUCA

May 9, 2019

Louis Rosenfeld

"Slack is growing steadily for us, but it’s hard to moderate and expensive at scale."

Louis Rosenfeld

The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld

June 5, 2024