ICTACT Journal on Image and Video Processing

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

An Improved Exemplar-Based Image Inpainting Algorithm for Error Concealment


Affiliations
1 Institute of Information Science, Kim Il-sung University, Korea, Democratic People's Republic of
     

   Subscribe/Renew Journal


Error concealment is an important technique to improve the video quality in case that the video frame is corrupted during transmission. A spatial error concealment algorithm based on the improved exemplar-based image inpainting is presented. Each corrupted macroblock is separated into sixteen 4×4 blocks, and a 4×4 block-based image inpainting is used for error concealment. In the exemplar-based inpainting process the best matching patch is determined by calculating the weighted sum of squared differences for the available patch regions which includes already concealed blocks. Experimental results show that our proposed method achieves better quality in terms of objective and subjective evaluations compared with the previous algorithms.

Keywords

Video Communication, Error Concealment, Exemplar Based Image Inpainting.
Subscription Login to verify subscription
User
Notifications
Font Size

  • S. Aign and K. Fazel, “Temporal and Spatial Error Concealment Techniques for Hierarchical MPEG-2 Video Codec”, Proceedings of IEEE International Conference Communication, pp. 1778-1783, 1995.

  • W. Kwok and H. Sun, “Multi-Directional Interpolation for Spatial Error Concealment”, IEEE Transactions on Consumer Electronics, Vol. 39, No. 3, pp. 455-460, 1993.

  • Jae-Won Suh and Yo-Sung Ho, “Error Concealment based on Directional Interpolation”, IEEE Transactions on Consumer Electronics, Vol. 43, No. 3, pp. 295-302, 1997.

  • Wonki Kim, Jasung Koo and Jechang Jeong, “Fine Directional Interpolation for Spatial Error Concealment”, IEEE Transactions on Consumer Electronics, Vol. 52, No. 3, pp. 1050-1056, 2006.

  • Z. Wang, Y. Yu and D. Zhang, “Best Neighborhood Matching: An Information Loss Restoration Technique for Block based Image Coding Systems”, IEEE Transactions on Image Processing, Vol. 7, No. 6, pp. 1056-1061, 1998.

  • J.W. Park and S.U. Lee, “Recovery of Corrupted Image Data based on the NURBS Interpolation”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 9, No. 10, pp. 1003-1008, 1999.

  • S.C. Hsia, “An Edge-Oriented Spatial Interpolation for Consecutive Block Error Concealment”, IEEE Signal Processing Letters, Vol. 11, No. 6, pp. 577-580, 2004.

  • X. Li and M. Orchard, “Novel Sequential ErrorConcealment Techniques using Orientation Adaptive Interpolation”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 12, No. 10, pp. 857-864, 2002.

  • Zhang Rongfu, Zhou Yuanhua and Huang Xiaodong, “Content Adaptive Spatial Error Concealment for Video Communication”, IEEE Transactions on Consumer Electronics, Vol. 50, No. 1, pp. 335-341, 2004.

  • D. Agrafiotis, D.R. Bull and C.N. Canagarajah, “Enhanced Error Concealment with Mode Selection”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 16, No. 8, pp. 960-973, 2006.

  • A. Criminisi, P. Perez and K. Toyama, “Object Removal by Examplar-based Image Inpainting”, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 721-728, 2003.

  • A. Criminisi, P. Perez and K. Toyama, “Region Filling and Object Removal by Exemplar-based Image Inpainting”, IEEE Transactions on Image Processing, Vol. 13, No. 9, pp.1200-1212, 2004.

  • B.R. Li, Y. Qi and X.K. Shen, “An Image Inpainting Method”, Proceedings of 9th International Conference on Computer Aided Design and Computer Graphics, pp. 531536, 2005.

  • C.Y. Chen, G.L. Wu and S.Y. Chien, “Hardware-Oriented Image Inpainting for Perceptual I-Frame Error Concealment”, Proceedings of IEEE International Symposium on Circuits and Systems, pp. 836-839, 2008.

  • L.W. Guan, Y.C Ching and Y.C. Shao, “Algorithm and Architecture Design of Image Inpainting Engine for Video Error Concealment Applications”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, No. 6, pp. 792-803, 2011.

  • Mounira Ebdelli, Olivier Le Meur and Christine Guillemot, “Analysis of Patch-based Similarity Metrics: Application to Denoising”, Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2070-2074, 2013.

  • Mounira Ebdelli, Olivier Le Meur and Christine Guillemot, “Loss Concealment based on Video Inpainting for Robust Video Communication”, Proceedings of 20th European Signal Processing Conference, pp. 1910-1914, 2012.

  • Hou Yu, Ma Ran, Li Panpan, An Ping, and Shi Nandi, “Hybrid Inter-frame Error Concealment Algorithm using Improved Image Inpainting”, Journal of Computer-Aided Design and Computer Graphics, Vol. 28, No. 2, pp. 280287, 2016.

  • Chengxing Li et al., “An Adaptive Error Concealment Algorithm based on Partition Model”, Proceedings of Chinese Conference on Image and Graphics Technologies, pp. 35-43, 2016

  • T.L. Lin, T.L. Ding, C.Y. Fan and W.C. Chen, “Error Concealment Algorithm based on Sparse Optimization”, Multimedia Tools and Applications, Vol. 76, No. 1, pp. 397413, 2017.


Abstract Views: 260

PDF Views: 6




  • An Improved Exemplar-Based Image Inpainting Algorithm for Error Concealment

Abstract Views: 260  |  PDF Views: 6

Authors

Hwang Byongsu
Institute of Information Science, Kim Il-sung University, Korea, Democratic People's Republic of
Jo Jonghyon
Institute of Information Science, Kim Il-sung University, Korea, Democratic People's Republic of
Ri Cholsu
Institute of Information Science, Kim Il-sung University, Korea, Democratic People's Republic of

Abstract


Error concealment is an important technique to improve the video quality in case that the video frame is corrupted during transmission. A spatial error concealment algorithm based on the improved exemplar-based image inpainting is presented. Each corrupted macroblock is separated into sixteen 4×4 blocks, and a 4×4 block-based image inpainting is used for error concealment. In the exemplar-based inpainting process the best matching patch is determined by calculating the weighted sum of squared differences for the available patch regions which includes already concealed blocks. Experimental results show that our proposed method achieves better quality in terms of objective and subjective evaluations compared with the previous algorithms.

Keywords


Video Communication, Error Concealment, Exemplar Based Image Inpainting.

References