We will present two late-breaking works at CHI 2025 in Yokohama, Japan on generative AI for creativity support and AI-supported spatial learning.

SketchAI: A “Sketch-First” Approach to Incorporating Generative AI into Fashion Design

Full Abstract

Generative AI technologies are increasingly being incorporated into creativity support tools. However, most generative AI tools rely on text-based prompting, requiring users to translate visual ideas into linguistic descriptions. This approach is misaligned with the sketch-driven workflows of creative professionals. To address this gap, we introduce SketchAI, a novel sketch-first interface for diffusion models that allows practitioners to use real-time sketching on a tablet computer to guide model outputs. Through a qualitative study with 29 fashion design apprentices, we explored the interface’s potential impacts on creative workflows. While some participants identified use cases where SketchAI streamlined routine tasks, others expressed concerns about its potential to undermine creative agency and exploration. These findings unearthed hidden complexity: while generative AI can support some aspects of creativity, its core capabilities may challenge the central identity of creative practitioners. While SketchAI does not resolve this problem, it does take a meaningful step towards reconciliation.

Authors

• Richard Lee Davis
• Kevin Fred Mwaita
• Livia Müller
• Daniel C. Tozadore
• Aleksandra Novikova
• Tanja Käser
• Thiemo Wambsganss

SpatiaLearn: Exploring XR Learning Environments for Reflective Writing

Full Abstract

Reflective writing promotes deeper learning by enhancing metacognitive awareness and critical thinking, but learners often struggle with structuring their reflections and maintaining focus. Generative AI and advances in spatial computing offer promising solutions. Extended reality (XR) environments create immersive, distraction-free settings, while conversational agents use dialog-based scaffolding guides to structure learners’ thoughts. However, research on combining dialog-based scaffolding with XR for reflective writing remains limited. To address this, we introduce SpatiaLearn, an adaptive XR tool that enhances reflective writing through conversational guidance in both traditional and immersive environments. A within-subjects study (N = 19) compared participants’ performance in traditional laptop and XR environments. Qualitative analysis shows the spatial interface enhances engagement but raises challenges like unfamiliar interactions and health concerns, requiring task adaptation for XR. This study advances the design of immersive tools for reflective writing, highlighting both the opportunities and challenges of spatial interfaces.

Authors

• Jinqiao Li
• Seyed Parsa Neshaei
• Livia Müller
• Roman Rietsche
• Richard Lee Davis
• Thiemo Wambsganns