Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
  1. Home
  2. Search

Refine search

Refine search

Access:
Content type:
Publication date:
Apply   From and To filters
Subject: Show more
Journals Show more
Publishers: Show more
Societies Show more
Series: Show more
Collections: Show more

Actions for selected content:

Select all | Deselect all
  • View selected items
  • Export citations
  • Download PDF (zip)
  • Save to Kindle
  • Save to Dropbox
  • Save to Google Drive

Save Search

You can save your searches here and later view and run them again in "My saved searches".

Please provide a title, maximum of 40 characters.
Cancel
×

2 results

  • Evaluating optimal reference translations – ERRATUM

  • Vilém Zouhar, Věra Kloudová, Martin Popel, Ondřej Bojar
  • Journal:
    Natural Language Processing ,
    Published online by Cambridge University Press:
    27 May 2024, p. 1
    • Article
      • You have access
      • Open access
    • PDF
    • HTML
    • Export citation

  • Evaluating optimal reference translations

  • Vilém Zouhar, Věra Kloudová, Martin Popel, Ondřej Bojar
  • Journal:
    Natural Language Processing ,
    Published online by Cambridge University Press:
    08 May 2024, pp. 1-24
    • Article
      • You have access
      • Open access
    • PDF
    • HTML
    • Export citation

  • The overall translation quality reached by current machine translation (MT) systems for high-resourced language pairs is remarkably good. Standard methods of evaluation are not suitable nor intended to uncover the many translation errors and quality deficiencies that still persist. Furthermore, the quality of standard reference translations is commonly questioned and comparable quality levels have been reached by MT alone in several language pairs. Navigating further research in these high-resource settings is thus difficult. In this paper, we propose a methodology for creating more reliable document-level human reference translations, called “optimal reference translations,” with the simple aim to raise the bar of what should be deemed “human translation quality.” We evaluate the obtained document-level optimal reference translations in comparison with “standard” ones, confirming a significant quality increase and also documenting the relationship between evaluation and translation editing.