Unknown

Dataset Information

0

Mixed Script Identification Using Automated DNN Hyperparameter Optimization.


ABSTRACT: Mixed script identification is a hindrance for automated natural language processing systems. Mixing cursive scripts of different languages is a challenge because NLP methods like POS tagging and word sense disambiguation suffer from noisy text. This study tackles the challenge of mixed script identification for mixed-code dataset consisting of Roman Urdu, Hindi, Saraiki, Bengali, and English. The language identification model is trained using word vectorization and RNN variants. Moreover, through experimental investigation, different architectures are optimized for the task associated with Long Short-Term Memory (LSTM), Bidirectional LSTM, Gated Recurrent Unit (GRU), and Bidirectional Gated Recurrent Unit (Bi-GRU). Experimentation achieved the highest accuracy of 90.17 for Bi-GRU, applying learned word class features along with embedding with GloVe. Moreover, this study addresses the issues related to multilingual environments, such as Roman words merged with English characters, generative spellings, and phonetic typing.

SUBMITTER: Yasir M 

PROVIDER: S-EPMC8683192 | biostudies-literature | 2021

REPOSITORIES: biostudies-literature

altmetric image

Publications

Mixed Script Identification Using Automated DNN Hyperparameter Optimization.

Yasir Muhammad M   Chen Li L   Khatoon Amna A   Malik Muhammad Amir MA   Abid Fazeel F  

Computational intelligence and neuroscience 20211210


Mixed script identification is a hindrance for automated natural language processing systems. Mixing cursive scripts of different languages is a challenge because NLP methods like POS tagging and word sense disambiguation suffer from noisy text. This study tackles the challenge of mixed script identification for mixed-code dataset consisting of Roman Urdu, Hindi, Saraiki, Bengali, and English. The language identification model is trained using word vectorization and RNN variants. Moreover, throu  ...[more]

Similar Datasets

2015-05-25 | GSE53984 | GEO
| S-EPMC11603601 | biostudies-literature
| S-EPMC9305872 | biostudies-literature
| S-EPMC7146897 | biostudies-literature
| S-EPMC9355632 | biostudies-literature
| S-EPMC7038525 | biostudies-literature
| S-EPMC11901684 | biostudies-literature
| S-EPMC8495939 | biostudies-literature
| S-EPMC8584383 | biostudies-literature
| S-EPMC11633816 | biostudies-literature