Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

Sonification of Face


Affiliations
1 Department of Information Technology, Goa College of Engineering, Goa, India
     

   Subscribe/Renew Journal


In this paper, the integration of face segments detection and extraction, and facial expression recognition and Sonification are discussed. In this paper, we propose an algorithm that utilizes haar classifiers detecting face followed by dividing face into Regions of interest (ROI) to extract facial segments. Furthermore, in this project, we propose a statistical approach to process the optical flow data to obtain the overall value for the respective feature region in the face. This approach has eliminated the requirement of accurate identification of the feature boundary. Optical flow computations are utilized to identify the directions and the amount of motions in image sequences that are caused by human facial expressions. These calculated values are then compared with the values from table to estimate the expression .Furthermore after getting the expression; these are then converted to sound by mapping functions. Sounds are generated by simple MIDI tunes based on instruments assigned to each region.

Keywords

Face Detection, Denseoptical Flow, Expression Analysis, Haar Classifier Cascade, Lucas-Kanadeoptical Flow Algorithm, Sound Generation.
User
Subscription Login to verify subscription
Notifications
Font Size

Abstract Views: 269

PDF Views: 1




  • Sonification of Face

Abstract Views: 269  |  PDF Views: 1

Authors

Vaishakh Patil
Department of Information Technology, Goa College of Engineering, Goa, India
Mohammed Qassim Akhtar
Department of Information Technology, Goa College of Engineering, Goa, India
Abhijit Parab
Department of Information Technology, Goa College of Engineering, Goa, India
Aisha Fernandes E. Colaco
Department of Information Technology, Goa College of Engineering, Goa, India

Abstract


In this paper, the integration of face segments detection and extraction, and facial expression recognition and Sonification are discussed. In this paper, we propose an algorithm that utilizes haar classifiers detecting face followed by dividing face into Regions of interest (ROI) to extract facial segments. Furthermore, in this project, we propose a statistical approach to process the optical flow data to obtain the overall value for the respective feature region in the face. This approach has eliminated the requirement of accurate identification of the feature boundary. Optical flow computations are utilized to identify the directions and the amount of motions in image sequences that are caused by human facial expressions. These calculated values are then compared with the values from table to estimate the expression .Furthermore after getting the expression; these are then converted to sound by mapping functions. Sounds are generated by simple MIDI tunes based on instruments assigned to each region.

Keywords


Face Detection, Denseoptical Flow, Expression Analysis, Haar Classifier Cascade, Lucas-Kanadeoptical Flow Algorithm, Sound Generation.



DOI: https://doi.org/10.36039/ciitaas%2F4%2F8%2F2012%2F106893.405-408