Noisy Uyghur Text Normalization

Noisy Uyghur Text Normalization

Author(s): Osman Tursun & Ruket Çakıcı
Computer Engineering Department
Middle East Technical University, Ankara Turkey
Publisher: Association for Computational Linguistics
Abstract
Uyghur is the second largest and most actively used social media language in China. However, a non-negligible part of Uyghur text appearing in social media is unsystematically written with the Latin alphabet, and it continues to increase in size. Uyghur text in this format is incomprehensible and ambiguous even to native Uyghur speakers. In addition, Uyghur texts in this form lack the potential for any kind of advancement for the NLP tasks related to the Uyghur language. Restoring and preventing noisy Uyghur text written with unsystematic Latin alphabets will be essential to the protection of Uyghur language and improving the accuracy of Uyghur NLP tasks. To this purpose, in this work we propose and compare the noisy channel model and the neural encoder-decoder model as normalizing methods.

Anthology ID: W17-4412
Volume: Proceedings of the 3rd Workshop on Noisy User-generated Text
Month: September
Year: 2017
Publisher: Association for Computational Linguistics
Pages: 85–93

Download (PDF)

Noisy Uyghur Text Normalization

Leave a Reply

Your email address will not be published. Required fields are marked *