Effort in Semi-Automatized Subtitling Processes

Speech Recognition and Experience during Transcription





speech recognition, effort, transcription, eyetracking, keylogging, subtitling processes


The presented study investigates the impact of automatic speech recognition (ASR) and assisting scripts on effort during transcription and translation processes, two main subprocesses of interlingual subtitling. Applying keylogging and eye tracking, this study takes a first look at how the integration of ASR impacts these subprocesses. 12 professional subtitlers and 13 translation students were recorded performing two intralingual transcriptions and three translation tasks to evaluate the impact on temporal, technical, and cognitive effort, and split-attention. Measures include editing time, visit count and duration, insertions, and deletions. The main findings show that, in both tasks, ASR did not significantly impact task duration, but participants had fewer keystrokes, indicating less technical effort. Regarding visual attention the existence of an ASR script did not decrease the time spent replaying the video. The study also shows that students were less efficient in their typing and made more use of the ASR script. The results are discussed in context of the experiment and an outlook on further research is given.


Download data is not yet available.

Author Biography

Anke Tardel, Johannes Gutenberg University Mainz

Anke Tardel studied at the Faculty of Translation Studies, Linguistics and Cultural Studies in Germersheim, where she received her B.A. and her M.A. degree in Translation. Besides her studies, she has been a student research assistant since 2012, supporting various eye tracking studies and research projects.
As of October 2017, she is a PhD student, research assistant, and lecturer at the same faculty. Her research interests include translation process research, adiovisual translation, translation revision, post-editing, translation technologies, and cognitive translation studies.




How to Cite

Tardel, A. (2020). Effort in Semi-Automatized Subtitling Processes: Speech Recognition and Experience during Transcription. Journal of Audiovisual Translation, 3(2), 79–102. https://doi.org/10.47476/jat.v3i2.2020.131



Special Issue: November 2020