International Journal of Advanced Networking and Applications

Open Access Open Access  Restricted Access Subscription Access

Fingerspelling Identification for American Sign Language Based on Resnet-18


Affiliations
1 College of Computer and Communication, Hunan Institute of Engineering, Xiangtan 411104, China
 

Sign language as the main communication channel for deaf and hearing people, plays a very important role in daily life. With the rapid development of the field of deep learning, the field of sign language recognition has ushered in new opportunities. Aiming at the small number of sign language samples and low detection accuracy, an American sign language detection method based on Resnet-18 and data augmentation is proposed. First, the sign language picture is adjusted to 64 × 64 size using the filling method, and then the data is augmented by methods such as chromaticity change, rotation, and noise addition to increase the diversity of data samples and improve the robustness of the detection method. The experimental results show that the accuracy of the sign language recognition method based on Resnet-18 can reach 99%, which provides a new method for sign language recognition

Keywords

Convolutional Neural Network, Data augmentation, Resnet-18, Sign Language Recognition.
User
Notifications
Font Size


  • Fingerspelling Identification for American Sign Language Based on Resnet-18

Abstract Views: 292  |  PDF Views: 1

Authors

Han-Wen Zhang
College of Computer and Communication, Hunan Institute of Engineering, Xiangtan 411104, China
Ying Hu
College of Computer and Communication, Hunan Institute of Engineering, Xiangtan 411104, China
Yong-Jia Zou
College of Computer and Communication, Hunan Institute of Engineering, Xiangtan 411104, China
Cheng-Yu Wu
College of Computer and Communication, Hunan Institute of Engineering, Xiangtan 411104, China

Abstract


Sign language as the main communication channel for deaf and hearing people, plays a very important role in daily life. With the rapid development of the field of deep learning, the field of sign language recognition has ushered in new opportunities. Aiming at the small number of sign language samples and low detection accuracy, an American sign language detection method based on Resnet-18 and data augmentation is proposed. First, the sign language picture is adjusted to 64 × 64 size using the filling method, and then the data is augmented by methods such as chromaticity change, rotation, and noise addition to increase the diversity of data samples and improve the robustness of the detection method. The experimental results show that the accuracy of the sign language recognition method based on Resnet-18 can reach 99%, which provides a new method for sign language recognition

Keywords


Convolutional Neural Network, Data augmentation, Resnet-18, Sign Language Recognition.

References