VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents

Excerpt

arXiv:2610.04706v1 Announce Type: cross Abstract: People write and sketch while speaking to explain, organize, and develop content together. Inspired by these practices, we investigate how voice agents can use a canvas alongside speech in multi-turn conversations with users. We conducted a two-part formative study: an observational study of how pairs coordinated speech and boardwork, followed by a design workshop that informed a design space for speech-canvas interaction with voice agents. Build