Previous research on audiovisual input attests to a significant effect of on-screen text and proficiency on learning gains. However, there is scarce research on whether these factors affect viewers’ feeling of learning, a variable that can affect overall second language (L2) learning outcomes (Ellis, 2008). Moreover, there is a lack of research exploring whether viewing experience prompts viewers to switch from one viewing mode (subtitles, captions, no on-screen text) to another and what factors affect those choices. This study explores learners’ perspectives on learning from audiovisual input and their preferred viewing mode before and after participating in a prolonged viewing intervention. A total of 136 participants of varying L2 English proficiency levels (from A1 to C2) completed pre-viewing and post-viewing questionnaires. The results show that vocabulary and expressions were perceived to be learnt the most. The elementary proficiency group were more likely to be positive about learning from the intervention than higher proficiency students. Concerning the preferred viewing mode outside of the classroom, the participants favoured no on-screen text or first language (L1) subtitles over L2 captions. At the end of the intervention, the elementary-level participants found that viewing without any L1 support was too challenging for leisure viewing, while the intermediate- and advanced-level students gained confidence in watching without any textual support.

This study investigated how semantically relevant auditory information might affect the reading of subtitles, and if such effects might be modulated by the concurrent video content. Thirty-four native Chinese speakers with English as their second language watched video with English subtitles in six conditions defined by manipulating the nature of the audio (Chinese/L1 audio vs. English/L2 audio vs. no audio) and the presence versus absence of video content. Global eye-movement analyses showed that participants tended to rely less on subtitles with Chinese or English audio than without audio, and the effects of audio were more pronounced in the presence of video presentation. Lexical processing of subtitles was not modulated by the audio. However, Chinese audio, which presumably obviated the need to read the subtitles, resulted in more superficial post-lexical processing of the subtitles relative to either the English or no audio. On the contrary, English audio accentuated post-lexical processing of the subtitles compared with Chinese audio or no audio, indicating that participants might use English audio to support subtitle reading (or vice versa) and thus engaged in deeper processing of the subtitles. These findings suggest that, in multimodal reading situations, eye movements are not only controlled by processing difficulties associated with properties of words (e.g., their frequency and length) but also guided by metacognitive strategies involved in monitoring comprehension and its online modulation by different information sources.

Accessibility in immersive media is a relevant research topic, still in its infancy. This article explores the appropriateness of two rendering modes (fixed-positioned and always-visible) and two guiding methods (arrows and auto-positioning) for subtitles in 360° video. All considered conditions have been implemented and integrated in an end-to-end platform (from production to consumption) for their validation and evaluation. A pilot study with end users has been conducted with the goals of determining the preferred options by users, the options that result in a higher presence, and of gathering extra valuable feedback from the end users. The obtained results reflect that, for the considered 360° content types, always-visible subtitles were more preferred by end users and received better results in the presence questionnaire than the fixed-positioned subtitles. Regarding guiding methods, participants preferred arrows over auto-positioning because arrows were considered more intuitive and easier to follow and reported better results in the presence questionnaire.