Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

“Feels Like Paper!”: Interfacing AI through Paper
Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist and 1 more.

Share the love for this talk
“Feels Like Paper!”: Interfacing AI through Paper
Speakers: Lukas Moro
Link:

Summary

“Feels Like Paper!” is a series of prototypes about augmenting physical paper through AI. Various ML models, LLMs and a mixed reality headset are used to infuse physical paper and ink with properties of the digital world without compromising on their physical traits.

Key Insights

  • Physical paper retains unique tactile qualities that people naturally gravitate toward for reading, writing, and drawing.

  • Augmented reality can augment handwriting math input and provide instant, contextual AI-generated answers projected close to the user’s writing.

  • Mixed reality interfaces enable a tight coupling between physical and virtual objects, making digital content feel part of the physical world with shadow and spatial alignment.

  • AI agents embodied in physical objects scattered in our environment offer localized, context-aware assistance rather than a single all-knowing AI entity.

  • Designing AI interfaces means designing for variable behaviors, as AI outputs are not deterministic and can change with context and prompts.

  • Embodied interfaces can sometimes function without visible augmentation, using physical actions like highlighting combined with speech to synchronize digital data.

  • Real-time image diffusion used as a co-creative muse on physical drawings creates a hierarchical relationship where AI inspires but does not dictate final outcomes.

  • Smart glasses with egocentric cameras offer new opportunities for natural interaction but raise significant privacy concerns that need careful attention.

  • Interaction choreography and microgestures are critical for socially acceptable use of smart glasses in public or professional environments.

  • Future interfaces may allow uninterrupted coexistence of physical and virtual content on a single perceptual layer, enhancing sensory saturation and collaboration.

Notable Quotes

"Conventional user interfaces have a very low rate of information exchange between the user and the technology."

"Augmenting our sensors through AI becomes possible with increasingly egocentric perspectives on the user’s context."

"The interaction comes to the foreground mainly when there’s a negotiation of intentionality between the user and the technology."

"Physical paper has a special tactility to it; people still gravitate back to it because of this nature."

"It is very important to be aware of augmentations because otherwise they can feel very intrusive to the user."

"There is a tight coupling of physical and digital objects that makes the physical world more fluid and the virtual world gain physical traits."

"With Draw Dream, the AI acts as a muse, giving inspiration but not the final outcome."

"Realtime model feedback on egocentric inputs really feels like lucid dreaming."

"Designing for AI means designing for behavior because you will not always get the same result for the same question."

"We need to factor in the specifics of the social situation when designing interaction models and gestures for smart glasses."

Ask the Rosenbot
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
Jen Cardello
Curating insight: Strategies for integrating knowledge across research functions
2025 • Advancing Research 2025
Gold
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold
Ryan Matthew
Bridging Design and Code: AI-Powered Design System Integration
2025 • DesignOps Summit 2025
Gold
Sarah Barrett
The "How" of Enterprise Information Architecture
2023 • Enterprise UX 2023
Gold
Jacqui Frey
Scale is Social Work
2020 • DesignOps Community
Irina Tikhonova
Small Wins, Big Impact: Leveraging and Elevating User Engagement
2021 • Civic Design 2021
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Bria Alexander
Day 1 Panel: Up to the Minute: The latest in AI’s impact on UX
2025 • Designing with AI 2025
Gold
Robin Beers
Beyond Insights: Researchers as Organizational Change Catalysts
2024 • Advancing Research 2024
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Feleesha Sterling
Building a Rapid Research Program
2023 • Enterprise Community
Bria Alexander
The Big Question about Resilience: A panel discussion
2024 • DesignOps Summit 2024
Gold
Anupama Dhareshwar
From blueprint to bot: Designing resilient AI-powered services
2025 • Advancing Service Design 2025
Conference

More Videos

Kavana Ramesh

"It’s like showing up to a building and the elevator’s not working, so you have to take the stairs—that’s what happens when my preferred navigation methods don’t work."

Kavana Ramesh

Meaningful inclusion: Practicing accessibility research with confidence

September 24, 2024

Rima Campbell

"The Quality Experience score helps executives make confident decisions by summarizing digital experience quality in a single number."

Rima Campbell Amrit S Bhachu

Increase Productivity and Drive Business Impact

September 24, 2024

Bria Alexander

"Sponsors believe in advancing research, and we wouldn’t be here without them."

Bria Alexander Louis Rosenfeld

Opening Remarks Day 1

March 25, 2024

Kim Lenox

"Design is really a team sport, and we are investing in specialists to help with design systems, operations, research, and content strategy."

Kim Lenox

Leading Distributed Global Teams

May 20, 2019

Louis Rosenfeld

"Imagine a world where research bots at IBM talk to the Rosen bot to give you better guidance on interpreting research."

Louis Rosenfeld

The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld

June 5, 2024

Steve Portigal

"The curse of good enough is a real trap that we’re grappling with."

Steve Portigal

Looking Back…to Look Ahead

March 26, 2024

Maggie Dieringer

"Getting designers into a cadence of reviewing work with senior stakeholders was not a muscle the team had built."

Maggie Dieringer

Creating Consistency Through Constant Change

January 8, 2024

Brigette Metzler

"Research repositories and libraries are social things — many teams look for best practices beyond just building a library."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community

August 27, 2020

Sam Proulx

"Users with physical challenges often can see and interpret prototypes but may need help clicking through them because assistive tech may not support the prototype system."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

October 1, 2021