Rosenverse

This video is only accessible to conference ticket holders.

Log in Create account

For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.

Contact Support if you are having any issues.

“Feels Like Paper!”: Interfacing AI through Paper
Conference ticket
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist.

Share the love for this talk
“Feels Like Paper!”: Interfacing AI through Paper
Speakers: Lukas Moro
Link:

Summary

“Feels Like Paper!” is a series of prototypes about augmenting physical paper through AI. Various ML models, LLMs and a mixed reality headset are used to infuse physical paper and ink with properties of the digital world without compromising on their physical traits.

Key Insights

  • Physical paper retains unique tactile qualities that people naturally gravitate toward for reading, writing, and drawing.

  • Augmented reality can augment handwriting math input and provide instant, contextual AI-generated answers projected close to the user’s writing.

  • Mixed reality interfaces enable a tight coupling between physical and virtual objects, making digital content feel part of the physical world with shadow and spatial alignment.

  • AI agents embodied in physical objects scattered in our environment offer localized, context-aware assistance rather than a single all-knowing AI entity.

  • Designing AI interfaces means designing for variable behaviors, as AI outputs are not deterministic and can change with context and prompts.

  • Embodied interfaces can sometimes function without visible augmentation, using physical actions like highlighting combined with speech to synchronize digital data.

  • Real-time image diffusion used as a co-creative muse on physical drawings creates a hierarchical relationship where AI inspires but does not dictate final outcomes.

  • Smart glasses with egocentric cameras offer new opportunities for natural interaction but raise significant privacy concerns that need careful attention.

  • Interaction choreography and microgestures are critical for socially acceptable use of smart glasses in public or professional environments.

  • Future interfaces may allow uninterrupted coexistence of physical and virtual content on a single perceptual layer, enhancing sensory saturation and collaboration.

Notable Quotes

"Conventional user interfaces have a very low rate of information exchange between the user and the technology."

"Augmenting our sensors through AI becomes possible with increasingly egocentric perspectives on the user’s context."

"The interaction comes to the foreground mainly when there’s a negotiation of intentionality between the user and the technology."

"Physical paper has a special tactility to it; people still gravitate back to it because of this nature."

"It is very important to be aware of augmentations because otherwise they can feel very intrusive to the user."

"There is a tight coupling of physical and digital objects that makes the physical world more fluid and the virtual world gain physical traits."

"With Draw Dream, the AI acts as a muse, giving inspiration but not the final outcome."

"Realtime model feedback on egocentric inputs really feels like lucid dreaming."

"Designing for AI means designing for behavior because you will not always get the same result for the same question."

"We need to factor in the specifics of the social situation when designing interaction models and gestures for smart glasses."

Lada Gorlenko
Theme 1: Intro
2024 • Enterprise Experience 2020
Gold
Sarah Fathallah
Beyond insights: Rethinking the role of researchers as stewards of organizational wisdom
2025 • Advancing Research 2025
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • DesignOps Summit 2023
Gold
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Prerna Makanawala
Achieving Balanced Design Consistency
2021 • Design at Scale 2021
Gold
Vicky Teinaki
Short Take #3: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Fatimah Richmond
The Future of ReOps as a Strategic Function: A Roadmap for Getting There
2024 • Advancing Research 2024
Gold
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group
Charlotte Lee
Theme 1 Intro
2021 • Civic Design 2021
Gold
Dalia El-Shimy
So You've Got a Seat at the Table. Now What?
2020 • Advancing Research 2020
Gold
Briana Thomas
When Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org
2021 • DesignOps Summit 2021
Gold
Sharon Banh
Reimagining research: What does the field need to grow? [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Lena Shenkarenko
Collaborative Wireframing for Creating Team Alignment and Shipping Better Products
2020 • DesignOps Summit 2020
Gold
Megan Clegg
Space for Everyone: Reframing Accessibility Through a Wider Lens
2021 • Design at Scale 2021
Gold
Terry Buckman
Wargaming (An Introduction)
2023 • Enterprise Community
Ian Swinson
Designing and Driving UX Careers
2016 • Enterprise UX 2016
Gold

More Videos

John Calhoun

"A design ops career ladder can look like a step stool unless you create multiple tracks for growth and specialization."

John Calhoun Rachel Posman

Two Sides of the DesignOps Coin: Teams Ops and Product Ops

January 8, 2024

Laura Gatewood

"The bigger the impact, the higher the title that should send the message."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Erin Weigel

"Compound effect means good upon good upon good eventually builds to incredibly fast growth."

Erin Weigel

UX Lessons from running more than 1,200 A/B Tests

July 10, 2024

Susan Simon-Daniels

"Steve just talked about humans being humans in a world full of humans."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Noreen Whysel

"One thing I learned from working with product people is how to speak their language like all disciplines."

Noreen Whysel Katie Saindon

Short Take #4: UX/Product Lessons from Your Industry Peers

December 6, 2022

Jorge Arango

"You can be most successful at using new note-taking tools if you bring to the practice a different set of mental models."

Jorge Arango

Exploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)

April 19, 2024

Lisa Welchman

"People can have the same values and ideas but if you don’t tune them properly, you just don’t get what you want."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Zariah Cameron

"Lived experiences like poverty or homelessness bring a richer, deeper lens than a textbook study ever could."

Zariah Cameron

Streamlining an Inclusive Design Practice

October 3, 2023

Louis Rosenfeld

"Most bad panels feel like a bunch of people showing up at the last minute without shared goals or preparation."

Louis Rosenfeld Jemma Ahmed Christian Crumlish Uday Gajendar Chris Geison

Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?

May 2, 2024