We are very excited to join forces with MLCommons and OctoML.ai! Contact Grigori Fursin for more details!

Automatic Spelling Correction for Resource-Scarce Languages using Deep Learning

lib:429ab605466e8540 (v1.0.0)

Authors: Pravallika Etoori,Manoj Chinnakotla,Radhika Mamidi
Where published: ACL 2018 7
Document:  PDF  DOI 
Abstract URL: https://www.aclweb.org/anthology/P18-3021/


Spelling correction is a well-known task in Natural Language Processing (NLP). Automatic spelling correction is important for many NLP applications like web search engines, text summarization, sentiment analysis etc. Most approaches use parallel data of noisy and correct word mappings from different sources as training data for automatic spelling correction. Indic languages are resource-scarce and do not have such parallel data due to low volume of queries and non-existence of such prior implementations. In this paper, we show how to build an automatic spelling corrector for resource-scarce languages. We propose a sequence-to-sequence deep learning model which trains end-to-end. We perform experiments on synthetic datasets created for Indic languages, Hindi and Telugu, by incorporating the spelling mistakes committed at character level. A comparative evaluation shows that our model is competitive with the existing spell checking and correction techniques for Indic languages.

Relevant initiatives  

Related knowledge about this paper Reproduced results (crowd-benchmarking and competitions) Artifact and reproducibility checklists Common formats for research projects and shared artifacts Reproducibility initiatives

Comments  

Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!