ICTACT Journal on Image and Video Processing

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

Performance Analysis of Audio and Video Synchronization Using Spreaded Code Delay Measurement Technique


Affiliations
1 Department of Electronics and Communication Engineering, Anna University, Chennai, India
     

   Subscribe/Renew Journal


The audio and video synchronization plays an important role in speech recognition and multimedia communication. The audio-video sync is a quite significant problem in live video conferencing. It is due to use of various hardware components which introduces variable delay and software environments. The synchronization loss between audio and video causes viewers not to enjoy the program and decreases the effectiveness of the programs. The objective of the synchronization is used to preserve the temporal alignment between the audio and video signals. This paper proposes the audio-video synchronization using spreading codes delay measurement technique. The performance of the proposed method made on home database and achieves 99% synchronization efficiency. The audio-visual signature technique provides a significant reduction in audio-video sync problems and the performance analysis of audio and video synchronization in an effective way. This paper also implements an audio- video synchronizer and analyses its performance in an efficient manner by synchronization efficiency, audio-video time drift and audio-video delay parameters. The simulation result is carried out using Matlab simulation tools and Simulink. It is automatically estimating and correcting the timing relationship between the audio and video signals and maintaining the Quality of Service.

Keywords

Synchronization, Software, Hardware, Audio-Visual Spreading Codes, Temporal Alignment.
Subscription Login to verify subscription
User
Notifications
Font Size

  • Alka Jindal and Sucharu Aggarwal, “Comprehensive Overview of Various Lip Synchronization Techniques”, Proceedings of International Symposium on Biometrics and Security Technologies, pp. 23-29, 2008.

  • K. Anitha Sheela, Balakrishna Gudla, Srinivasa Rao Chalamala and B. Yegnanarayana, “Improved Lip Contour Extraction for Visual Speech Recognition”, Proceedings of International Conference on Consumer Electronics, pp. 459-462, 2015.

  • N.J. Bryan, G.J. Mysore and P. Smaragdis, “Clustering and Synchronizing Multicamera Video via Landmark Cross-Correlation”, Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2389-2392, 2012.

  • Claus Bauer, Kent Terry and Regunathan Radhakrishnan, “Audio and Video Signature for Synchronization”, Proceedings of IEEE International Conference on Multimedia and Exposition Community, pp. 1549-1552, 2008.

  • N. Dave and N.M. Patel. “Phoneme and Viseme based Approach for Lip Synchronization”, International Journal of Signal Processing, Image Processing and Pattern Recognition, Vol. 7, No. 3, pp. 385-394, 2014.

  • Dennis Laurijssen and Erik Verreycken, “Low-Cost Synchronization of High speed Audio and Video Recording in Bio-Acoustic”, International Journal of Experimental Biology, Vol. 8, No. 2, pp. 1-22, 2017.

  • Dragan Sekulovski, Hans Weda, Mauro Barbieri and Prarthana Shrestha, “Synchronization of Multiple Camera Videos using Audio-Visual Features”, IEEE Transactions on Multimedia, Vol. 12, No. 1, pp. 79-92, 2010.

  • Fumei Liu, Wenliang and Zeliang Zhang, “Review of the Visual Feature Extraction Research”, Proceedings of IEEE 5th International Conference on Software Engineering and Service Science, pp. 449-452, 2014.

  • Josef Chalaupka and Nguyen Thein Chuong, “Visual Feature Extraction for Isolated Word Visual only Speech Recognition of Vietnamese”, Proceedings of IEEE 365th International Conference on Telecommunication and Signal Processing, pp. 459-463, 2013.

  • K. Kumar, V. Libal, E. Marcheret, J. Navratil, G. Potamianos and G. Ramaswamy, “Audio-Visual Speech Synchronization Detection using a Bimodal Linear Prediction Model”, Proceedings of Computer Vision and Pattern Recognition Workshops, pp. 54-57, 2009.

  • Laszlo Boszormenyi, Mario Guggenberger and Mathias Lux, “Audio Align-Synchronization of A/V Streams based on Audio Data”, Proceedings of IEEE International Symposium on Multimedia, pp. 382-383, 2012.

  • Y. Liu and Y. Sato, “Recovering Audio-to-Video Synchronization by Audiovisual Correlation Analysis”, Proceedings of 195th International Conference on Pattern Recognition, pp. 1-2, 2008.

  • C. Lu and M. Mandal, “An Efficient Technique for Motion-based View-Variant Video Sequences Synchronization”, Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1-6, 2011.

  • Luca Lombardi and Waqqas ur Rehman Butt, “A Survey of Automatic Lip Reading Approaches”, Proceedings of IEEE 85th International Conference Digital Information Management, pp. 299-302, 2013.

  • Namrata Dave, “A Lip Localization based Visual Feature Extraction Methods”, An International Journal on Electrical and Computer Engineering, Vol. 4, No. 4, pp. 23-28, 2015.

  • P. Shrstha, M. Barbieri and H. Weda, “Synchronization of Multi-Camera Video Recordings based on Audio”, Proceedings of 155th International Conference on Multimedia, pp. 545-548, 2007.


Abstract Views: 314

PDF Views: 0




  • Performance Analysis of Audio and Video Synchronization Using Spreaded Code Delay Measurement Technique

Abstract Views: 314  |  PDF Views: 0

Authors

A. Thenmozhi
Department of Electronics and Communication Engineering, Anna University, Chennai, India
P. Kannan
Department of Electronics and Communication Engineering, Anna University, Chennai, India

Abstract


The audio and video synchronization plays an important role in speech recognition and multimedia communication. The audio-video sync is a quite significant problem in live video conferencing. It is due to use of various hardware components which introduces variable delay and software environments. The synchronization loss between audio and video causes viewers not to enjoy the program and decreases the effectiveness of the programs. The objective of the synchronization is used to preserve the temporal alignment between the audio and video signals. This paper proposes the audio-video synchronization using spreading codes delay measurement technique. The performance of the proposed method made on home database and achieves 99% synchronization efficiency. The audio-visual signature technique provides a significant reduction in audio-video sync problems and the performance analysis of audio and video synchronization in an effective way. This paper also implements an audio- video synchronizer and analyses its performance in an efficient manner by synchronization efficiency, audio-video time drift and audio-video delay parameters. The simulation result is carried out using Matlab simulation tools and Simulink. It is automatically estimating and correcting the timing relationship between the audio and video signals and maintaining the Quality of Service.

Keywords


Synchronization, Software, Hardware, Audio-Visual Spreading Codes, Temporal Alignment.

References