TRANSLATING BEYOND WORDS: PARALINGUISTIC CHALLENGES IN MACHINE TRANSLATION AND AUDIOVISUAL TRANSLATION

Main Article Content

Umidaxon Aslamova

Abstract

Translation is not limited to transferring words and grammatical structures from one language into another, because communication also depends on voice, emotion, intonation, pauses, gestures, facial expressions, and other paralinguistic signals. This article examines the main difficulties that arise when such information is transferred through machine translation and audiovisual translation. Particular attention is given to stress, intonation, tone of voice, hesitation, laughter, sarcasm, gestures, and culturally specific visual signals. The study uses a qualitative comparative approach and analyzes representative examples in order to identify how communicative meaning may be weakened or lost during automated translation. The discussion shows that a translation can be lexically and grammatically correct while still failing to reproduce the speaker’s emotional attitude or communicative intention. The article therefore argues that future translation technologies should treat paralinguistic information as an important part of meaning rather than as secondary information.

Article Details

Section

Articles

References

1.Birdwhistell, R. L. (1970). Kinesics and Context: Essays on Body Motion Communication. University of Pennsylvania Press.

2.Chaume, F. (2012). Audiovisual Translation: Dubbing. St. Jerome Publishing.

3.Díaz Cintas, J., & Remael, A. (2007). Audiovisual Translation: Subtitling. St. Jerome Publishing.

4.Hatim, B., & Mason, I. (1997). The Translator as Communicator. Routledge.

5.Kano, T., Sakti, S., Takamichi, S., Neubig, G., Toda, T., & Nakamura, S. (2012). A method for translation of paralinguistic information. Proceedings of the 9th International Workshop on Spoken Language Translation, 158–163.

6.Li, Y., Zhao, R., Zhang, R., Su, J., Wei, D., Zhang, M., & Chen, Y. (2026). PLaST: Towards paralinguistic-aware speech translation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(38), 31805–31813.

7.Nord, C. (1997). Alice abroad: Dealing with descriptions and transcriptions of paralanguage in literary translation. In F. Poyatos (Ed.), Nonverbal Communication and Translation: New Perspectives and Challenges in Literature, Interpretation and the Media (pp. 107–130). John Benjamins.

8.Poyatos, F. (1997). Aspects, problems and challenges of nonverbal communication in literary translation. In F. Poyatos (Ed.), Nonverbal Communication and Translation: New Perspectives and Challenges in Literature, Interpretation and the Media (pp. 17–48). John Benjamins.

9.Poyatos, F. (Ed.). (1997). Nonverbal Communication and Translation: New Perspectives and Challenges in Literature, Interpretation and the Media. John Benjamins.

10.Tsiamas, I., Sperber, M., Finch, A., & Garg, S. (2024). Speech is more than words: Do speech-to-text translation systems leverage prosody? Proceedings of the Ninth Conference on Machine Translation, 1235–1257.

11.Viaggio, S. (1997). Kinesics and the simultaneous interpreter: The advantages of listening with one's eyes and speaking with one's body. In F. Poyatos (Ed.), Nonverbal Communication and Translation (pp. 283–294). John Benjamins.

12.Zabalbeascoa, P. (1997). Dubbing and the nonverbal dimension of translation. In F. Poyatos (Ed.), Nonverbal Communication and Translation (pp. 327–342). John Benjamins.

13.Gumperz, J. J. (1982). Discourse Strategies. Cambridge University Press.

14.Halliday, M. A. K. (1978). Language as Social Semiotic: The Social Interpretation of Language and Meaning. Edward Arnold.

15.McNeill, D. (1992). Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press.

16.Mehrabian, A. (1972). Nonverbal Communication. Aldine-Atherton.