Rosenverse
“Feels Like Paper!”: Interfacing AI through Paper

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

“Feels Like Paper!”: Interfacing AI through Paper

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist and 1 more.

Share the love for this talk
“Feels Like Paper!”: Interfacing AI through Paper
Speakers: Lukas Moro
Link:

Summary

“Feels Like Paper!” is a series of prototypes about augmenting physical paper through AI. Various ML models, LLMs and a mixed reality headset are used to infuse physical paper and ink with properties of the digital world without compromising on their physical traits.

Key Insights

  • Physical paper retains unique tactile qualities that people naturally gravitate toward for reading, writing, and drawing.

  • Augmented reality can augment handwriting math input and provide instant, contextual AI-generated answers projected close to the user’s writing.

  • Mixed reality interfaces enable a tight coupling between physical and virtual objects, making digital content feel part of the physical world with shadow and spatial alignment.

  • AI agents embodied in physical objects scattered in our environment offer localized, context-aware assistance rather than a single all-knowing AI entity.

  • Designing AI interfaces means designing for variable behaviors, as AI outputs are not deterministic and can change with context and prompts.

  • Embodied interfaces can sometimes function without visible augmentation, using physical actions like highlighting combined with speech to synchronize digital data.

  • Real-time image diffusion used as a co-creative muse on physical drawings creates a hierarchical relationship where AI inspires but does not dictate final outcomes.

  • Smart glasses with egocentric cameras offer new opportunities for natural interaction but raise significant privacy concerns that need careful attention.

  • Interaction choreography and microgestures are critical for socially acceptable use of smart glasses in public or professional environments.

  • Future interfaces may allow uninterrupted coexistence of physical and virtual content on a single perceptual layer, enhancing sensory saturation and collaboration.

Notable Quotes

"Conventional user interfaces have a very low rate of information exchange between the user and the technology."

"Augmenting our sensors through AI becomes possible with increasingly egocentric perspectives on the user’s context."

"The interaction comes to the foreground mainly when there’s a negotiation of intentionality between the user and the technology."

"Physical paper has a special tactility to it; people still gravitate back to it because of this nature."

"It is very important to be aware of augmentations because otherwise they can feel very intrusive to the user."

"There is a tight coupling of physical and digital objects that makes the physical world more fluid and the virtual world gain physical traits."

"With Draw Dream, the AI acts as a muse, giving inspiration but not the final outcome."

"Realtime model feedback on egocentric inputs really feels like lucid dreaming."

"Designing for AI means designing for behavior because you will not always get the same result for the same question."

"We need to factor in the specifics of the social situation when designing interaction models and gestures for smart glasses."

Ask the Rosenbot
Niko Laitinen
Adaptable Org Design for Resilient Times
2021 • Design at Scale 2021
Gold
Magdalena Zadara
Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
2022 • Civic Design 2022
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Josh Clark
Sentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
2025 • Rosenfeld Community
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
Alexis Lucio
Scaling Accessibility Through Design Systems
2022 • Design at Scale 2022
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Alla Weinberg
How to Build and Scale Team Safety
2024 • DesignOps Summit 2020
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Julie Norvaisas
Back to basics, or start from scratch?
2025 • Advancing Research 2025
Gold
Sarah Gallimore
Inspire Progress with Artifacts from the Future
2022 • Civic Design 2022
Gold
Denise Jacobs
Interactive Keynote: Social Change by Design
2024 • Enterprise Experience 2020
Gold
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Jacqui Frey
Setting the Table for Dynamic Change
2019 • DesignOps Summit 2019
Gold
Rachel Posman
"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors
2024 • DesignOps Summit 2024
Gold
Katie Hansen
Finding the unknown in the known: Harnessing meta-analysis and literature review
2025 • Advancing Research 2025
Gold

More Videos

Alana Washington

"We’ve got Tim Gilligan, Meredith Blackbrand, and Bria Alexander on a panel about the future of design ops."

Alana Washington

Theme 3 Intro

October 1, 2021

Sofía Delsordo

"The design mindset was way more important than the bureaucratic mindset."

Sofía Delsordo Kassim Vera

Public Policy for Jalisco's Designers to Make Design Matter

December 8, 2021

Crystal Philcox

"When your whole operating model changes, you have to step back, breathe, restart, and rely on the best practices you’ve learned."

Crystal Philcox

The Many Faces of Operations

November 6, 2017

Sam Proulx

"It is very difficult for somebody who has never used assistive technology to have the same experience as someone who uses it daily for everything."

Sam Proulx

Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users

December 10, 2021

Sofia Quintero

"We think about research as the magnetic field that attracts every part of the business into alignment around the customer."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Doug Powell

"We make the invisible visible and turn abstract strategy into something people can see, touch, and act on."

Doug Powell

DesignOps and the Next Frontier: Leading Through Unpredictable Change

September 11, 2025

Johanna Kollmann

"What we measure is super important because it determines what people pay attention to. Without governance, priorities and ratings become outdated."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

Joel Branch

"Almost 90% of data science projects do not make it into production—they die on the vine."

Joel Branch

Humanizing AI: Filling the Gaps with Multi-faceted Research

March 11, 2021

Katie Johnson

"Building on AI and generative AI means giving up control."

Katie Johnson

Disrupting generative AI products with just-in-time consumer insights

June 4, 2024