标题：Segmentation Strategies to Face Morphology Challenges in Brazilian-Portuguese/English Statistical Machine Translation and Its Integration in Cross-Language Information Retrieval
摘要：The use of morphology is particularly inter- esting in the context of statistical machine translation in order to reduce data sparseness and compensate a lack of training corpus. In this work, we propose several approaches to introduce morphology knowledge into a standard phrase-based machine translation sys- tem. We provide word segmentation using two differ- ent tools ( COGROO and MORFESSOR ) which allow re- ducing the vocabulary and data sparseness. Then, to these segmentations we add the morphological in- formation of a POS language model. We combine all these approaches using a Minimum Bayes Risk strat- egy. Experiments show significant improvements from the enhanced system over the baseline system on the Brazilian-Portuguese/English language pair. Finally, we report a case study of the impact of enhancing the sta- tistical machine translation system with morphology in a cross-language application system such as ONAIR which allows users to look for information in video fragments through queries in natural language.
其他摘要：The use of morphology is particularly inter- esting in the context of statistical machine translation in order to reduce data sparseness and compensate a lack of training corpus. In this work, we propose several approaches to introduce morphology knowledge into a standard phrase-based machine translation sys- tem. We provide word segmentation using two differ- ent tools ( COGROO and MORFESSOR ) which allow re- ducing the vocabulary and data sparseness. Then, to these segmentations we add the morphological in- formation of a POS language model. We combine all these approaches using a Minimum Bayes Risk strat- egy. Experiments show significant improvements from the enhanced system over the baseline system on the Brazilian-Portuguese/English language pair. Finally, we report a case study of the impact of enhancing the sta- tistical machine translation system with morphology in a cross-language application system such as ONAIR which allows users to look for information in video fragments through queries in natural language.
关键词：Morphology; factored-based machine trans- lation; cross-language information retrieval.
其他关键词：Morphology; factored-based machine trans- lation; cross-language information retrieval.
Loading...
