Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
  1. Home
  2. Search

Refine search

Refine search

Access:
Content type:
Publication date:
Apply   From and To filters
Subject: Show more
Journals Show more
Publishers: Show more
Societies Show more
Series: Show more
Collections: Show more

Actions for selected content:

Select all | Deselect all
  • View selected items
  • Export citations
  • Download PDF (zip)
  • Save to Kindle
  • Save to Dropbox
  • Save to Google Drive

Save Search

You can save your searches here and later view and run them again in "My saved searches".

Please provide a title, maximum of 40 characters.
Cancel
×

2 results

  • Statistical machine translation for Indic languages

  • Sudhansu Bala Das, Divyajyoti Panda, Tapas Kumar Mishra, Bidyut Kr. Patra
  • Journal:
    Natural Language Processing ,
    Published online by Cambridge University Press:
    03 June 2024, pp. 1-18
    • Article
      • You have access
      • Open access
    • PDF
    • HTML
    • Export citation

  • Statistical Machine Translation (SMT) systems use various probabilistic and statistical Natural Language Processing (NLP) methods to automatically translate from one language to another language while retaining the originality of the context. This paper aims to discuss the development of bilingual SMT models for translating English into fifteen low-resource Indic languages (ILs) and vice versa. The process to build the SMT model is described and explained using a workflow diagram. Samanantar and OPUS corpus are utilized for training, and Flores200 corpus is used for fine-tuning and testing purposes. The paper also highlights various preprocessing methods used to deal with corpus noise. The Moses open-source SMT toolkit is being investigated for the system’s development. The impact of distance-based reordering and Morpho-syntactic Descriptor Bidirectional Finite-State Encoder (msd-bidirectional-fe) reordering on ILs is compared in the paper. This paper provides a comparison of SMT models with Neural Machine Translation (NMT) for ILs. All the experiments assess the translation quality using standard metrics such as BiLingual Evaluation Understudy, Rank-based Intuitive Bilingual Evaluation Score, Translation Edit Rate, and Metric for Evaluation of Translation with Explicit Ordering. From the result, it is observed that msd-bidirectional-fe reordering performs better than the distance-based reordering model for ILs. It is also noticed that even though the IL-English and English-IL systems are trained using the same corpus, the former performs better for all the evaluation metrics. The comparison between SMT and NMT shows that across various languages, SMT performs better in some cases, while NMT outperforms in others.

  • 4 - The Evolving Treatment of Semantics in Machine Translation

  • Edited by Meng Ji, University of Sydney, Michael Oakes, University of Wolverhampton
  • Book:
    Advances in Empirical Translation Studies
    Published online:
    10 June 2019
    Print publication:
    13 June 2019, pp 53-76

  • Summary

    John Searle and other influential theorists have argued that machine translation (MT) and other natural language processing (NLP) programs can never appreciate meaning in the deepest sense – in other words, that they can never truly exhibit semantics. It is true that MT and many other NLP systems have made steady and impressive progress while use of explicit semantic processing has undergone a rise and fall. It is also true that consensus among researchers on the meaning of meaning has remained elusive. In this chapter, however, we observe renewed interest in semantic representation and processing. Moreover, we foresee gradual adoption of semantic approaches grounded upon audio, visual, or other sensor-based input. We distinguish such perceptually-grounded semantic approaches from most current methods, which have tended to remain perception-free. With respect to philosophical implications, we suggest that perceptually-grounded approaches to automatic natural language processing can display intentionality, and thus foster a truly meaningful semantics. As background for these predictions and suggestions, we survey the role of semantics in machine translation to date in terms of three paradigms: rule-based, statistical, and neural MT. A section on each paradigm discusses its treatment of semantics: rule-based methods have generally emphasized symbolic semantics; statistical methods have generally avoided semantic treatment or employed vector-based semantics; and neural methods have handled meaning as implicit within networks.