Design a site like this with
Get started



Interaction Prototyping With Video: Bridging Video Interaction Analysis and Design

Welcome to the Course

In this course, you will learn how to use video data for prototyping. The course provides hands-on training in working with video clips, including transcription and identification of relevant actions. You will familiarize yourself with core interaction analytic concepts (grounded in ethnomethodology and conversation analysis) and will learn how to do an action-by-action analysis. Working on the design case of everyday interaction with automatic doors, you will learn how video interaction analysis can be embedded in an iterative design process.

You can find detailed information on our page on the CHI website.

Course Information


Designing for social and collaborative interaction can be challenging. Video recording interaction with technology helps to capture problems and creates a record that can be rewatched later. While there is a long history of video analysis and design focus has typically been on design or just video analysis. This course aims to introduce course participants to a more integrated and iterative view of video interaction analysis and design.

General Information

Duration and course format

4 x 75 minutes sessions.

Session 1: Introduction to interaction analysis & transcription
Session 2: Transcript-based Reenactments
Session 3: Data session and transcription workshop
Session 4: Story boarding and wrap up

Course date and Schedule

Tuesday, May 3.

Course delivery

The course is planned and will be taught as in person course. It will be possible to watch the course online but we cannot guarantee the full experience. Please contact the organizers if you plan to participate via Zoom.


Hannah Pelikan

PhD candidate
Language and Culture, Linköping University

In her research, she combines video interaction analysis (ethnomethodology & conversation analysis) with research through design approaches. She has published on human-robot interaction at CHI, HRI and CSCW and co-organized workshops at HRI’21 and ICSR’20. She received her Masters in Interaction Technology from University of Twente, NL and teaches students from various backgrounds, including computer science.

Yoyo Tsung-Yu Hou

PhD student
Information Science, Cornell University

His research focuses on social interaction in Human-Robot Interaction and Human-Agent Interaction, especially on how social power theories can be used as a framework for designing interactive agents. Prior to his PhD, he worked in the industry as a UX designer for home robots with his dual backgrounds in psychology and product design.

Jenny Fu

PhD student
Information Science, Cornell University

Her research interests center on exploring how robots and AI agents can influence people’s interaction between each other and applying social psychological theories to design conversational agents. Prior to Cornell, she received her undergraduate degree in Cognitive Science from Brown University.

Leelo Keevallik

Language and Interaction, Linköping University

She has worked on the interface between grammar and embodiment, targeting the systematic use of language, sound, and movement in various activities involving co-present humans. Among other things, she has studied how vocalizations are used to coordinate manual work tasks and dance instruction. She has recently published a handbook on multimodal interaction analysis.

Mathias Broth

Language and Interaction, Linköping University

Taking particular interest in the embodied, emplaced and mediated aspects of situated human interaction, he has studied activities such as TV-production and driver training as these are interactionally accomplished in real time. He has recently published a handbook on multimodal interaction analysis.

Malte Jung

Information Science, Cornell University

With a focus on moment-to-moment interactions, he has studied design teams as well teams that work with robots and other automated systems in order to design systems that help teams develop better interactions.

Contact Information


May 3, 2022, 9:30 – 17:30


Room 392, Ernest N. Morial Convention Center, New Orleans.