From Linguistic to Visual Context in Machine Translation
- Intervenant·e
- Rachel Bawden (Inria Paris)
- Date
- Lieu
- Salle 306, bâtiment IMAG + visio
From the very beginning of natural language processing, one of the most important issues has been ambiguity, when words, phrases or sentences have multiple meanings. For Machine Translation (MT), ambiguity is an issue when those meanings result in different translations. Is French trombone a paperclip or a musical instrument? If the fans are out of order, is there a problem at the football (supporteurs) or a ventilation problem (ventilateurs). Traditionally, MT was carried out sentence by sentence, and such sentences could be lacking the context necessary to distinguish between correct and incorrect translations. Since then, contextual MT has been growing in popularity, with the inclusion of both linguistic and extra-linguistic context. New evaluation strategies have also been developed to target context-dependent phenomena, since the usual metrics are ill-adapted. In this talk, I will start by introducing contextual MT using linguistic context, including some of my earlier work carried out in evaluation and more recent work for the evaluation of the multilingual language model BLOOM. I will then describe recent work in the inclusion of visual context for disambiguation in MT, including a new test set and an adapted multimodal MT approach.
