Research Cell: An International Journal of Engineering Sciences

Open Access Open Access  Restricted Access Subscription Access

Syntactic Error Detection System Using HMM


Affiliations
1 Research Scholar, SBBS University, Jalandhar, India
2 Associate Professor, DAV University, Jalandhar, India
 

Having an error detection and correction system is a fundamental requirement for any word processing application such as MS Word, Applix Word, JWPce, KWord, etc. Despite various efforts to develop such systems using rule-based, statistical-based, and other machine learning approaches, none of them have been satisfactory. The author of this research proposes an algorithm that utilizes the Hidden Markov Model to detect grammatical errors in input sentences. The Viterby algorithm is used to implement the Hidden Markov Model, and an annotated corpus from ILCI is used to calculate the HMM parameters. The results of testing the system on three types of datasets showed an overall precision of 100%, recall of 93.83%, and an f-measure of 96.7. The proposed algorithm has the potential to be used in the development of similar systems for other Indian languages.

Keywords

Grammar Checker, Syntactic Analyzer, Error Detection, HMM.
User
Notifications
Font Size

  • . B. Behera and P. Bhattacharyya, “Automated Grammar Correction Using Hierarchical Phrase-Based Statistical Machine Translation,” Proc. Sixth Int. Jt. Conf. Nat. Lang. Process., pp. 937–941, 2013.

  • . Holan, T., Kubon, V., & Plátek, M. (1997, March). A prototype of a grammar checker for Czech. In Fifth Conference on Applied Natural Language Processing (pp. 147-154).

  • . Atwell, E. S. “How to detect grammatical errors in a text without parsing it,” In Proceedings of the third conference on European chapter of the Association for Computational Linguistics, pp38-45,1987

  • . J. Eeg-olofsson and O. Knutsson, “Automatic Grammar Checking for Second Language Learners – the Use of Prepositions,” 2001.

  • . G. Fliedner, “A System for Checking NP Agreement in German Texts Correct : seinen Argumenten,” no. July, pp. 12–17, 2002.

  • . K. M. A. Hasan, A. Mondal, and A. Saha, “Recognizing Bangla Grammar Using Predictive Parser,” vol. 3, no. 6, pp. 61–73, 2011.

  • . S. S. Hashemi, Automatic Detection of Grammar Errors in Primary School Children’s Texts. 2003.

  • . S. Hein, “A Chart-Based Framework for Grammar Checking Initial Studies,” no. 1996, pp. 1–12, 1998.

  • . Kubon, V., & Plátek, M. (1994). A grammar based approach to a grammar checking of free word order languages. In COLING 1994 Volume 2: The 15th International Conference on Computational Linguistics.

  • . Paggio, P. (2000, April). Spelling and grammar correction for Danish in SCARRIE. In Proceedings of the sixth conference on applied natural language processing (pp. 255-261). Association for Computational Linguistics.

  • . Park, J. C., Palmer, M. S., & Washburn, C. (1997, March). An English Grammar Checker as a Writing Aid for Students of English as a Second Language. In ANLP (Vol. 24, No. 10.3115, pp. 974281-974296).

  • . Tschichold, C., Bodmer, F., Cornu, E., Grosjean, F., Grosjean, L., Kübler, N. & Tschumi, C. (1997). Developing a new grammar checker for English as a second language. In From Research to Commercial Applications: Making NLP Work in Practice.

  • . T. Vosse and P. O. Box, “Detecting and Correcting Morpho-syntactic Errors in Real Texts Nijmegen Institute for Cognition and Information University of Nijmegen Cognitive Technology Foundation,” pp. 111–118, 1990.

  • . Young-soog, “Improvement of Korean Proofreading System Using Corpus and Collocation Rules,” pp. 328–333, 1998.

  • . M. S. Gill, “A Grammar Checking System for Punjabi,” no. August, pp. 149–152, 2008.

  • . Schmidt-Wigger, “Grammar and Style Checking for German,” Proc. Second Int. Work. Control Lang. Appl. CLAW1998, no. Ii, pp. 76–86, 1998.

  • . L. Bopche and G. Dhopavakar, “Rule Based Grammar Checking System for Hindi,” vol. 3, no. 1, pp. 45–47, 2012.

  • . Arppe, “Developing a grammar checker for Swedish,” 12th Nord. Conf. Comput. Linguist. pp. 13–27, 2000.

  • . R. Bustamante and F. S. León, “GramCheck: A Grammar and Style Checker,” 1996.

  • . J. Carlberger and R. Domeij, “A Swedish Grammar Checker,” 2002.

  • . H. Kabir, S. Nayyer, J. Zaman, and S. Hussain, “Two Pass Parsing Implementation for an Urdu Grammar Checker."


Abstract Views: 213

PDF Views: 0




  • Syntactic Error Detection System Using HMM

Abstract Views: 213  |  PDF Views: 0

Authors

Leekha Jindal
Research Scholar, SBBS University, Jalandhar, India
Ravinder Jindal
Research Scholar, SBBS University, Jalandhar, India
Sanjeev Kumar Sharma
Associate Professor, DAV University, Jalandhar, India

Abstract


Having an error detection and correction system is a fundamental requirement for any word processing application such as MS Word, Applix Word, JWPce, KWord, etc. Despite various efforts to develop such systems using rule-based, statistical-based, and other machine learning approaches, none of them have been satisfactory. The author of this research proposes an algorithm that utilizes the Hidden Markov Model to detect grammatical errors in input sentences. The Viterby algorithm is used to implement the Hidden Markov Model, and an annotated corpus from ILCI is used to calculate the HMM parameters. The results of testing the system on three types of datasets showed an overall precision of 100%, recall of 93.83%, and an f-measure of 96.7. The proposed algorithm has the potential to be used in the development of similar systems for other Indian languages.

Keywords


Grammar Checker, Syntactic Analyzer, Error Detection, HMM.

References