Artificial Intelligent Systems and Machine Learning

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

Conversion of American Sign Language into Text using Deep Learning .


Affiliations
1 no, India
     

   Subscribe/Renew Journal


The Sign language is one of the easy ways of communication to dumb and deaf people. Not all people can understand sign language; the requirement of sign language translator is high. This paper focuses on detecting sign language using deep learning concepts, which acts as a translator. The aim of this project is to convert sign language of static type into its corresponding text. This is done using 2 main steps, data creation and training and deploying the model. The process include real time input which is then converted into threshold image, later these images are trained using CNN model and finally feature classification is done. Then we obtain Static ASL output.

Keywords

Sign Language, Tensorflow, Keras, Numpy, OpenCV, Deep Learning .
User
Subscription Login to verify subscription
Notifications
Font Size

  • Ankita Wadhawan, Parteek Kumar” Deep learning-based sign language recognition system for static signs”, Springer-Verlag London Ltd., part of Springer Nature 2020, Neural Computing and Applications, https://doi.org/10.1007/s00521-019-04691- y.

  • Jain,V.,Jain,A.,Chauhan,A.etal.American Sign Language recognition using Support Vector Machine and Convolutional Neural Network Int.j.inf.tecnol.(2021).https://doi.org/10.1007/s41870- 021-00617-x.

  • K. Tiku, J. Maloo, A. Ramesh and I. R, "Real-time Conversion of Sign Language to Text and Speech", 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India, 2020, pp. 346-351, DOI:10.1109/ICIRCA48905.2020.9182877.

  • Lean karlo S. Tolentino, Ronnie O. Serfa Juan, August C. Thio-ac, Maria Abigail B. Pamahoy, Joni Rose R. Forteza, and Xavier jet O.

  • Garcia, “Static Sign language Recognition using Deep learning”, International journal of Machine learning and computing, Vol. 9, No.6, December2019.

  • Mahesh Kumar, Assistant Professor (Senior Grade), Bannari Amman Institute of Technology, Sathyamangalam, Erode, India. “Conversion of Sign Language into Text”, International Journal of Applied Engineering Research, Volume 13,2018

  • S. Rajaganapathy, B. Aravind, B. Keerthana, M. Sivagami, “Conversation of Sign Language to Speech with Human Gestures”, Procedia Computer Science, Volume 50,2015.

  • P. Vijayalakshmi and M. Aarthi, "Sign language to speech conversion,"

  • International Conference on RecentTrends in Information Technology (ICRTIT), Chennai, 2016, pp. 1-6, doi: 10.1109/ICRTIT.2016.7569545.

  • A. Kumar, K. Thankachan and M. M. Dominic, "Sign language recognition," 2016 3rd International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, 2016, pp. 422-428, doi: 10.1109/RAIT.2016.7507939.

  • K. S. Warrier, J. K. Sahu, H. Halder, R. Koradiya and V. K. Raj,

  • "Software based sign language converter," 2016 International

  • Conference on Communication and Signal Processing (ICCSP),

  • Melmaruvathur, 2016, pp. 1777-1780,

  • doi:10.1109/ICCSP.2016.7754472.

  • TY - JOUR,AU - Arsan, Taner,AU - Ulgen, Oguz,PY - 2015/08/31,SP -

  • ,EP - 51,T1 - Sign Language Converter,VL - 6,DO -

  • 5121/ijcses.2015.6403,JO - International Journal of Computer

  • Science & Engineering Survey

  • R. R. Itkarkar and A. V. Nandi, "Hand gesture to speech conversion using Matlab," 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT), Tiruchengode, 2013, pp. 1-4, doi: 10.1109/ICCCNT.2013.6726505.

  • K. A. Bhaskaran, A. G. Nair, K. D. Ram, K. Ananthanarayanan and H.

  • R. Nandi Vardhan, "Smart gloves for hand gesture recognition: Sign language to speech conversion system," 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), Kollam, 2016, pp. 1-6, doi: 10.1109/RAHA.2016.7931887.


Abstract Views: 97

PDF Views: 0




  • Conversion of American Sign Language into Text using Deep Learning .

Abstract Views: 97  |  PDF Views: 0

Authors

A. K. Srilakshmi
no, India
N. Yashaswini
no, India
Anitha Suresh
no, India

Abstract


The Sign language is one of the easy ways of communication to dumb and deaf people. Not all people can understand sign language; the requirement of sign language translator is high. This paper focuses on detecting sign language using deep learning concepts, which acts as a translator. The aim of this project is to convert sign language of static type into its corresponding text. This is done using 2 main steps, data creation and training and deploying the model. The process include real time input which is then converted into threshold image, later these images are trained using CNN model and finally feature classification is done. Then we obtain Static ASL output.

Keywords


Sign Language, Tensorflow, Keras, Numpy, OpenCV, Deep Learning .

References