[Critical Design] [2023] [ASSETS  Conference]

Non-speech information (NSI), things like music, footsteps, and gunshots, can be tricky to communicate with closed-captioning. We explored current problems with NSI captioning using a sound-visualizer prototype to better understand the problem.

The recorded talk and paper will be available in October 2023.

[Non-Speech Information in Captions] [2023] [Submitted to a Conference]

YouTube is the wonderful wild west of video streaming, and the captioning practices across YouTube are similarly wild. We take a systematic look at captioning practices over time on popular YouTube videos and are uncovering some interesting trends.

[New Captioning System]

"[Pop music plays]" or
"[Vroom Vroom by Charli XCX plays]" or
"[Dark, euphoric electronic pop music plays]"

Which do you prefer? Wouldn't it be great if captioning systems gave you these sorts of choices?