Open Access Open Access  Restricted Access Subscription Access

A Prototype Punjabi Text To Sign Language Automatic Translator


Affiliations
1 Department of Computer Science, Punjabi University, Patiala, India
 

Sign language, which is a method of communication for the hearing-impaired community, conveys meaning through manual communication and body language rather than through sound. This paper describes a Punjabi text to sign language translation method in prototype form. The suggested method accepts Punjabi text as input and produces Sign Language equivalents using synthetic animations. This system will help to disseminate information to deaf people in public utility places like railways, banks, hospitals, etc. This will also act as an educational tool in learning Sign Language.

Keywords

Indian Sign Language, Stemmer, Part of Speech Tagger.
User
Notifications
Font Size

  • Ehnolgue,Lanuage.”[Online].Available:https://www.ethnologue.com/subgroups/signlanguage. [Accessed: 20- Jun-2018].
  • R. San-Segundo et al., “Speech to sign language translation system for Spanish,” Speech Commun., vol. 50, no. 11–12, pp. 1009–1020, 2008.
  • S. O. Caballero-Morales and F. Trujillo-Romero, “3D Modeling of the Mexican Sign Language for a Speech-to-Sign Language System,” Comput. y Sist., vol. 17, no. 4, pp. 593–608, 2012.
  • S. M. Halawani, D. Daman, S. Kari, and A. R. Ahmad, “An Avatar Based Translation System from Arabic Speech to Arabic Sign Language for Deaf People,” Int. J. Comput. Sci. Netw. Secur., vol. 13, no. 12, pp. 43–52, 2013.
  • R. Elliott, J. R. W. Glauert, J. R. Kennaway, and I. Marshall, “The development of language processing support for the ViSiCAST project,” in Proceedings of the fourth international ACM conference on Assistive technologies - Assets ’00, 2000, pp. 101– 108.
  • P. Vijayalakshmi and M. Aarthi, “Sign language to speech conversion,” in Fifth International Conference on Recent Trends in Information Technology, 2016, pp. 1–6.
  • G. F. Simons and C. D. Fennig, Ethnologue: Languages of the world. Dallas, TX, USA: SIL, 2017.
  • U. Zeeshan, ‘‘Sign languages of the world,’’ in Encyclopedia of Language and Linguistics. Amsterdam, The Netherlands: Elsevier, 2006, pp. 358–365. [Online]. Available: http://clok.uclan.ac.uk/9631/
  • WHO (2018). Deafness and Hearing Loss. [Online]. Available: http://www.who.int/news-room/fact-sheets/detail/deafness-and-hearingloss
  • G. F. Simons and C. D. Fennig, Ethnologue: Languages of the world. Dallas, TX, USA: SIL, 2017.
  • T. Johnston, Sign Language: Morphology. Sydney, NSW, Australia: Elsevier, 2006. [Online]. Available: https://booksite.elsevier.com/samplechapters/9780080442990/ Look_Inside/11~Article-Sign_Language-Morphology.pdf
  • R. Mayberry, ‘‘Learning sign language as a second language,’’ in Encyclopedia of Language and Linguistics, K. Brown, Ed. Amsterdam, The Netherlands: Elsevier, 2006, pp. 6–739. [Online]. Available: https://philpapers.org/rec/MAYLSL
  • J. P. Morford and J. MacFarlane, ‘‘Frequency characteristics of american sign language,’’ Sign Lang. Stud., vol. 3, no. 2, pp. 213–225, Jan. 2003.
  • A. Schembri and T. A. Johnston, ‘‘Sociolinguistic variation in the use of fingerspelling in australian sign language: A pilot study,’’ Sign Lang. Stud., vol. 7, no. 3, pp. 319–347, Sep. 2007.
  • ISLRTC. (2017). Islrtc-Prepared With A Directory of ISL Interpreters in India. [Online]. Available: http://www.disabilityaffairs.gov.in/content/viewpage/islrtcpreparedwith-adirectory-of-isl-interpreters-in-india.php
  • B. Price. (2017). Sign Language Costs ’Too High’ for Some Families. [Online]. Available: http://www.bbc.co.uk/news/uk-wales-39270335
  • H. Knoors and D. Hermans, ‘‘Effective instruction for deaf and hard-of hearing students: Teaching strategies, school settings, and student characteristics,’’ Oxford Handbook Deaf Studies, Lang. Educ., vol. 2, pp. 57–71, Aug. 2010.
  • Brour, M., Benabbou, A.: Atlaslang mts 1: Arabic text language into arabic sign language machine translation system. Procedia Computer Science 148, 236–245 (2019). DOI 10.1016/j.procs.2019.01.066
  • Piper, A.M., Hollan, J.: Supporting medical conversations between deaf and hearing individuals with tabletop displays. pp. 147–156 (2008). DOI 10.1145/1460563.1460587
  • “State UT wise Persons with Disability,” [Online]. Available: http://disabilityaffairs.gov.in/content/page/state-ut-wise-persons.php. [Accessed: 3October-2019].
  • Marilyn, D., (1997). Benedictine Roots in the Development of Deaf Education: Listening with the Heart. Praeger Publishers Inc.
  • Elliott, R., Glauert, J. R. W., Kennaway, J. R., and Marshall, I., (2000). The development of language processing support for the ViSiCAST project, in Proceedings of the fourth international ACM conference on Assistive technologies - Assets ’00, (pp. 101–108), ACM.
  • Cox, S., Lincoln, M., Tryggvason, J., Nakisa, M., Wells, M., Tutt, M., and Abbott, S., (2002). TESSA, a system to aid communication with deaf people, in the fifth international ACM conference on Assistive technologies, (pp. 205–212), ACM.
  • Wray, A., Cox, S., Lincoln, M., and Tryggvason, J., (2004). A formulaic approach to translation at the post office: Reading the signs, Language and Communication, 24(1), (pp. 59–75), Elsevier.
  • Hanke, T., (2004). HamNoSys – Representing Sign Language Data in Language Resources and Language Processing Contexts, in LREC, 4, (pp. 1–6).
  • Raghavan, R. J., Prasad, K. A., Muraleedharan, R., and Geetha, M., (2013). Animation system for Indian Sign Language communication using LOTS notation, in International Conference on Emerging Trends in Communication, Control, Signal Processing and Computing Applications, (pp. 1–7), IEEE.
  • Kaur, R., and Kumar, P., (2014). HamNoSys Generation System for Sign Language, in International Conference on Advances in Computing, Communications and Informatics, (pp. 2727–2734), IEEE.
  • Kaur, R., and Kumar, P., (2017). Sign language based SMS generator for hearing impaired people, in 2017 International Conference on Computational Intelligence in Data Science(ICCIDS), (pp. 1–5), IEEE.
  • Shahriar, R., Zaman, A. G. M., Ahmed, T., Khan, S. M., and Maruf, H. M., (2017). A communication platform between bangla and sign language, in 5th IEEE Region 10 Humanitarian Technology Conference 2017, R10-HTC 2017, (pp. 1–4).
  • Sugandhi, Kumar, P., and Kaur, S., (2018). Online Multilingual Dictionary Using Hamburg Notation for Avatar-Based Indian Sign Language Generation System, International Journal of Cognitive and Language Sciences, 12(8), (pp. 1116–1122).
  • Kaur, S., and Singh, M., (2015). Indian Sign Language animation generation system, in 1st International Conference on Next Generation Computing Technologies, (pp. 909– 914), IEEE.
  • Verma, A., and Kaur, S., (2015). Indian Sign Language Automation Generation System for Gurmukhi Script, International Journal of Computer Science and Technology, 6(3), (pp. 117–121).
  • Nair, M. S., Nimitha, A. P., and Idicula, S. M., (2016). Conversion of Malayalam text to Indian sign language using synthetic animation, in 2016 International Conference on Next Generation Intelligent Systems, ICNGIS 2016, (pp. 1–4), IEEE.
  • Goyal, L., and Goyal, V., (2016). Development of Indian Sign Language Dictionary using Synthetic Animations, Indian Journal of Science and Technology, 9(32), (pp. 1–5).
  • Arsan, T., and Ulgen, O., (2015). Sign Language Converter, International Journal of Computer Science & Engineering Survey, 6(4), (pp. 39–51).
  • L. Goyal and V. Goyal, "Automatic Translation of English Text to Indian Sign Language Synthetic Animations," In 13th International Conference on Natural Language Processing, pp. 144-153, 2016.
  • J. Joy, K. Balakrishnan, and M. Sreeraj, “SignQuiz: A quiz based tool for learning fingerspelled signs in Indian sign language using ASLR,” Journal of IEEE Access, Vol. 7, pp. 28363–28371, 2019.
  • Dhanjal, Amandeep & Singh, Williamjeet. (2018). An Automatic Conversion of Punjabi Text to Indian Sign Language. ICST Transactions on Scalable Information Systems. 7. 165279. 10.4108/eai.13-7-2018.165279.
  • S. Mittal, N. Singh Sethi, and S. Kumar Sharma, “Part of Speech Tagging of Punjabi Language using N-Gram Model,” International J. Computer Application, Vol. 100, Issue 19, pp. 19–23, 2016.

Abstract Views: 275

PDF Views: 1




  • A Prototype Punjabi Text To Sign Language Automatic Translator

Abstract Views: 275  |  PDF Views: 1

Authors

Gurdeep Singh
Department of Computer Science, Punjabi University, Patiala, India

Abstract


Sign language, which is a method of communication for the hearing-impaired community, conveys meaning through manual communication and body language rather than through sound. This paper describes a Punjabi text to sign language translation method in prototype form. The suggested method accepts Punjabi text as input and produces Sign Language equivalents using synthetic animations. This system will help to disseminate information to deaf people in public utility places like railways, banks, hospitals, etc. This will also act as an educational tool in learning Sign Language.

Keywords


Indian Sign Language, Stemmer, Part of Speech Tagger.

References