International Journal of Advanced Networking and Applications

Open Access Open Access  Restricted Access Subscription Access

Performance Analysis of Audio and Video Synchronization using Spreaded Code Delay Measurement Technique


Affiliations
1 Department of ECE, Anna University, Chennai, India
 

The audio and video synchronization plays an important role in speech recognition and multimedia communication. The audio-video sync is a quite significant problem in live video conferencing. It is due to use of various hardware components which introduces variable delay and software environments. The objective of the synchronization is used to preserve the temporal alignment between the audio and video signals. This paper proposes the audio-video synchronization using spreading codes delay measurement technique. The performance of the proposed method made on home database and achieves 99% synchronization efficiency. The audio-visual signature technique provides a significant reduction in audio-video sync problems and the performance analysis of audio and video synchronization in an effective way. This paper also implements an audio- video synchronizer and analyses its performance in an efficient manner by synchronization efficiency, audio-video time drift and audio-video delay parameters. The simulation result is carried out using mat lab simulation tools and simulink. It is automatically estimating and correcting the timing relationship between the audio and video signals and maintaining the Quality of Service.

Keywords

Audio Spreading Codes, Hamming Distance Correlation, Spectrograph, Synchronization, Video Spreading Codes.
User
Notifications
Font Size

  • Alka Jindal, Sucharu Aggarwal, “Comprehensive overview of various lip synchronization techniques” IEEE International transaction on Biometrics and Security technologies, 2008.

  • Anitha Sheela.k, Balakrishna Gudla, Srinivasa Rao Chalamala, Yegnanarayana.B, “Improved lip contour extraction for visual speech recognition” IEEE International transaction on Consumer Electronics,pp.459-462, 2015.

  • N. J. Bryan, G. J. Mysore and P. Smaragdis, “Clustering and synchronizing multicamera video via landmark cross-correlation,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), March 2012, pp. 2389–2392.

  • Claus Bauer, Kent Terry, Regunathan Radhakrishnan, “Audio and video signature for synchronization” IEEE International conference on Multimedia and Exposition Community (ICME), pp.1549-1552, 2008.

  • N. Dave, N. M. Patel. "Phoneme and Viseme based Approach for Lip Synchronization.", International Journal of Signal Processing, Image Processing and Pattern Recognition, pp. 385-394, 2014.

  • Dragan Sekulovski, Hans Weda, Mauro Barbieri and Prarthana Shrestha, “Synchronization of Multiple Camera Videos Using Audio-Visual Features,” in IEEE Transactions On Multimedia, Vol. 12, No. 1, January 2010.

  • Fumei Liu, Wenliang, Zeliang Zhang, “Review of the visual feature extraction research” IEEE 5th International Conference on software Engineering and Service Science, pp.449-452, 2014.

  • Josef Chalaupka, Nguyen Thein Chuong, “Visual feature extraction for isolated word visual only speech recognition of Vietnamese” IEEE 36th International conference on Telecommunication and signal processing (TSP), pp.459-463, 2013.

  • K. Kumar, V. Libal, E. Marcheret, J. Navratil, G.Potamianos and G. Ramaswamy, “AudioVisual speech synchronization detection using a bimodal linear prediction model”. in Computer Vision and Pattern Recognition Workshops, 2009, p. 54.

  • Laszlo Boszormenyi, Mario Guggenberger, Mathias Lux, “Audio Align-synchronization of A/V streams based on audio data” IEEE International journal on Multimedia, pp.382-383, 2012.

  • Y. Liu, Y. Sato, “Recovering audio-to-video synchronization by audiovisual correlation analysis”. in Pattern Recognition, 2008, p. 2.

  • C. Lu and M. Mandal, “An efficient technique for motion-based view-variant video sequences synchronization,” in IEEE International Conference on Multimedia and Expo, July 2011, pp. 1–6.

  • Luca Lombardi, Waqqas ur Rehman Butt, “A survey of automatic lip reading approaches” IEEE 8th International Conference Digital Information Management (ICDIM), pp.299-302, 2013.

  • Namrata Dave, “A lip localization based visual feature extraction methods” An International journal on Electrical and computer Engineering, vol.4, no.4, December 2015.

  • P. Shrstha, M. Barbieri, and H. Weda, “Synchronization of multi-camera video recordings based on audio,” in Proceedings of the 15th international conference on Multimedia 2007, pp.545–548.


Abstract Views: 180

PDF Views: 0




  • Performance Analysis of Audio and Video Synchronization using Spreaded Code Delay Measurement Technique

Abstract Views: 180  |  PDF Views: 0

Authors

A. Thenmozhi
Department of ECE, Anna University, Chennai, India
P. Kannan
Department of ECE, Anna University, Chennai, India

Abstract


The audio and video synchronization plays an important role in speech recognition and multimedia communication. The audio-video sync is a quite significant problem in live video conferencing. It is due to use of various hardware components which introduces variable delay and software environments. The objective of the synchronization is used to preserve the temporal alignment between the audio and video signals. This paper proposes the audio-video synchronization using spreading codes delay measurement technique. The performance of the proposed method made on home database and achieves 99% synchronization efficiency. The audio-visual signature technique provides a significant reduction in audio-video sync problems and the performance analysis of audio and video synchronization in an effective way. This paper also implements an audio- video synchronizer and analyses its performance in an efficient manner by synchronization efficiency, audio-video time drift and audio-video delay parameters. The simulation result is carried out using mat lab simulation tools and simulink. It is automatically estimating and correcting the timing relationship between the audio and video signals and maintaining the Quality of Service.

Keywords


Audio Spreading Codes, Hamming Distance Correlation, Spectrograph, Synchronization, Video Spreading Codes.

References