| Peer-Reviewed

Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction

Received: 7 December 2021     Accepted: 27 December 2021     Published: 8 January 2022
Views:       Downloads:
Abstract

Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.

Published in International Journal of Applied Linguistics and Translation (Volume 8, Issue 1)
DOI 10.11648/j.ijalt.20220801.11
Page(s) 1-9
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.

Copyright

Copyright © The Author(s), 2022. Published by Science Publishing Group

Keywords

Multimodal Interaction, Subtitles, Chinese Translation

References
[1] Christine, G. (2012). Reading the visual: Using Kress and van Leeuwen for a framework. Metaphor, 28-34.
[2] Chen, HY. (2011). Multi-modal Subtitle Translation: A Case Study of Gone With the Wind. Film Review, 19, 71-73.
[3] Guo, JZ. (2009). Foreignization and Domestication: Moral Attitude and Discourse Strategy-A Review of the Second Edition of Venuti's Translator's Invisibility. Chinese Translators Journal, 194 (2): 34-38.
[4] Hu, MX, & Li, ZZ. (2018). Multimodal Speech: Conceptual Analysis and Research Prospects. Journal of PLA Foreign Languages University, 41 (03): 10-18.
[5] Kan, F. (2014). Film Subtitle Translation from the Perspective of Multi-modal Discourse Analysis. Qiqihar University.
[6] Liu, CL. (2016). An Interpretation of Domestication and Foreignization Strategies in Film and Television Subtitle Translation-A Case Study of Confessions of a Shopaholic and Friends. Journal of Hunan First Normal University, 16 (6): 91-95.
[7] Li, XT. (2019). Research on Multimodal Interaction and Chinese Multimodal Interaction. Language Teaching and Research, 4, 45-49.
[8] Li, YX. (2001). The Strategies of Subtitle Translation. Chinese Translators Journal, 4, 38-40.
[9] Lv, JY. (2008). Strategies of Film Subtitle Translation-Taking English Film Translation as an example. Film Literature, 5, 109-110.
[10] Wang, RB & Zhang, JY. (2020). An Empirical Study of the Development of 4-8-year-old Children’s Verbal-gestural Acts. Foreign Language Education, 41 (4): 69-74.
[11] Wei, QH. (2008). On the Overall Meaning Construction of Multimodal Discourse-Discourse Analysis Based on Multimodal Media Discourse. Journal of Tianjin Foreign Languages University, 6, 16-21.
[12] Xu, MJ. (2017). A Review of Multi-modal Translation Studies in China. Journal of Guangdong University of Foreign Studies, 28 (2): 40-46.
[13] Yuan, FL. (2010). Strategies for Translating Subtitles into Chinese-A Case Study of the American Sitcom Friends. Journal of Tianshui Normal University, 30 (1): 126-128.
[14] Zhang, DL. (2009). Research on Comprehensive Theoretical Framework of Multimodal Discourse Analysis. Chinese Foreign Languages, 6 (1): 24-30.
[15] Zhang, DL. (2018). A Comprehensive Framework for Multimodal Discourse Analysis from the Perspective of Systemic Functional Theory. Modern Foreign Languages, 41 (6): 731-743.
Cite This Article
  • APA Style

    Rongbin Wang, Yaoqin Xue, Haizhen Wei. (2022). Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. International Journal of Applied Linguistics and Translation, 8(1), 1-9. https://doi.org/10.11648/j.ijalt.20220801.11

    Copy | Download

    ACS Style

    Rongbin Wang; Yaoqin Xue; Haizhen Wei. Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. Int. J. Appl. Linguist. Transl. 2022, 8(1), 1-9. doi: 10.11648/j.ijalt.20220801.11

    Copy | Download

    AMA Style

    Rongbin Wang, Yaoqin Xue, Haizhen Wei. Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction. Int J Appl Linguist Transl. 2022;8(1):1-9. doi: 10.11648/j.ijalt.20220801.11

    Copy | Download

  • @article{10.11648/j.ijalt.20220801.11,
      author = {Rongbin Wang and Yaoqin Xue and Haizhen Wei},
      title = {Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction},
      journal = {International Journal of Applied Linguistics and Translation},
      volume = {8},
      number = {1},
      pages = {1-9},
      doi = {10.11648/j.ijalt.20220801.11},
      url = {https://doi.org/10.11648/j.ijalt.20220801.11},
      eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ijalt.20220801.11},
      abstract = {Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.},
     year = {2022}
    }
    

    Copy | Download

  • TY  - JOUR
    T1  - Cross-Modal Translation: A Study of English Subtitle Translation from the Perspective of Multimodal Interaction
    AU  - Rongbin Wang
    AU  - Yaoqin Xue
    AU  - Haizhen Wei
    Y1  - 2022/01/08
    PY  - 2022
    N1  - https://doi.org/10.11648/j.ijalt.20220801.11
    DO  - 10.11648/j.ijalt.20220801.11
    T2  - International Journal of Applied Linguistics and Translation
    JF  - International Journal of Applied Linguistics and Translation
    JO  - International Journal of Applied Linguistics and Translation
    SP  - 1
    EP  - 9
    PB  - Science Publishing Group
    SN  - 2472-1271
    UR  - https://doi.org/10.11648/j.ijalt.20220801.11
    AB  - Under the guidance of the Systemic-functional synthetic framework for multimodal discourse analysis, this paper collects multimodal corpus from the classical American TV show Friends and undertakes a thorough qualitative analysis of how cross-modal relations influence the Chinese translation of English subtitles. As is shown, in order to give Chinese viewers a better understanding of English subtitles in multimodal contexts, different translational approaches should be used for the translation of subtitles that are in different cross-modal relations, which are categorized into two general types, that is, complementary relation on the one hand and non-complementary relation on the other hand. The qualitative analysis in this paper finds that though strategies of translation that are appropriate to make use of in the process of English translation into Chinese include amplification, paraphrasing, annotation, direct translation, free translation, and linear translation, the choice of translation approach is directly influenced by cross-modal relations. For example, for subtitles that belong to multimodal discourse of reinforcing complementary relation, it is advisable for translators to make use of translational strategies of amplification, paraphrasing and annotation to highlight the foregrounded meaning expressed by the dominant modality on the one hand, and on the other hand to explicitly and verbally express the background information provided by the backgrounded modality if discourses of two modalities in the same scene form a relation of highlighting. As cross-modal communication becomes continuously widespread and the popularity of English shows keep arising in China, this paper endeavors to provide some useful implications for the translation of English subtitles, which as verbal and auditory discourse is part of a larger multimodal discourse in films.
    VL  - 8
    IS  - 1
    ER  - 

    Copy | Download

Author Information
  • School of Foreign Language Shanxi University, Taiyuan, China

  • School of Foreign Language Shanxi University, Taiyuan, China

  • School of Foreign Language Shanxi University, Taiyuan, China

  • Sections