海上视频增强关键技术研究进展
The Key Technologies of Maritime Video Enhancement: A Survey

作者: 杨 达 , 王孝通 :海军大连舰艇学院,航海系,大连; 徐冠雷 :海军大连舰艇学院,军事海洋系,大连;

关键词: 视频增强去雾稳像图像质量评价综述Video Enhancement Defogging Video Stabilizing Image Quality Accessment Review

摘要:
光电成像系统在航海领域得到了广泛的应用,但海上获取的视频常常降质严重,限制了其作用的发挥。针对海上视频图像降质主要原因是海雾和舰船摇晃与机械振动造成的,本文对海上视频去雾、稳像和视频图像客观无参考质量评价三个方面的关键技术进展进行简要综述,目的是使相关研究人员快速了解发展现状和最新动态。最后总结了海上视频增强的发展方向。

Abstract: Electro-optical surveillance systems have been widely used in maritime fields. However, severe degradation of video captured on the sea limits the usage. In view of the main reasons of video de-gradation which are sea fog and jitter, we briefly reviewed the technologies of defogging, stabilizing and non-reference image quality accessment, to enable researchers to understand the situation and the latest developments. Finally, further discussions are pointed out on future development.

文章引用: 杨 达 , 王孝通 , 徐冠雷 (2014) 海上视频增强关键技术研究进展。 图像与信号处理, 3, 87-93. doi: 10.12677/JISP.2014.34012

参考文献

[1] Odell, A.P. and Weinman, J.A. (1975) The effect of atmospheric haze on images of the earth’s surface. Journal of Geophysical Research, 80, 5035-5040.

[2] 禹晶, 徐东彬, 廖庆敏 (2011) 图像去雾技术研究进展. 中国图象图形学报, 9, 1561-1576.

[3] 郭璠, 蔡自兴, 谢斌, 唐琎 (2010) 图像去雾技术研究综述与展望. 计算机应用, 9, 2417-2421.

[4] Narasimhan, S.G. and Nayar, S.K. (2003) Contrast restoration of weather degraded images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 713-724.

[5] Shwartz, S., Namer, E. and Schechner, Y.Y. (2006) Blind haze separation. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, 1984-1991.

[6] 陈功, 王唐, 周荷琴 (2008) 基于物理模型的雾天图像复原新方法. 中国图象图形学报, 5, 888-893.

[7] Tan, R.T. (2008) Visibility in bad weather from a single image. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, 23-28 June 2008, 1-8.

[8] Fattal, R. (2008) Single image dehazing. ACM Transactions on Graphics (TOG), 27, 72.

[9] Tarel, J.P. and Hautiere, N. (2009). Fast visibility restoration from a single color or gray level image. IEEE 12th International Conference on Computer Vision, 2201-2208.

[10] He, K., Sun, J. and Tang, X. (2011) Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 2341-2353.

[11] 禹晶, 李大鹏, 廖庆敏 (2011) 基于物理模型的快速单幅图像去雾方法. 自动化学报, 2, 143-149.

[12] Rahman, Z.U., Woodell, G.A. and Jobson, D.J. (1997) A comparison of the multiscaleretinex with other image enhancement techniques. Is and T Annual Conference, The Society for Imaging Science and Technology, 426-431.

[13] Joshi, K.R. and Kamathe, R.S. (2008) Quantification of retinex in enhancement of weather degraded images. International Conference on Audio, Language and Image Processing, ICALIP 2008, Shanghai, 7-9 July 2008, 1229-1233.

[14] Vonikakis, V., Andreadis, I. and Gasteratos, A. (2008) Fast centre-surround contrast modification. IET Image Proce- ssing, 2, 19-34.

[15] 王守觉, 郭东辉, 丁兴号, 廖英豪 (2008) 一种新的仿生彩色图像增强方法. 电子学报, 10, 1970-1973.

[16] Lam, E.Y. (2005) Combining gray world and retinex theory for automatic white balance in digital photography. Proceedings of the 9th International Symposium on Consumer Electronics, ISCE 2005, Macau, 14-16 June 2005, 134-139.

[17] Gijsenij, A., Gevers, T. and van de Weijer, J. (2010) Generalized gamut mapping using image derivative structures for color constancy. International Journal of Computer Vision, 86, 127-139.

[18] Land, E.H. (1964) The retinex. American Scientist, 52, 247-264.

[19] Rahman, Z.U., Jobson, D.J. and Woodell, G.A. (2002) Retinex processing for automatic image enhancement. In: Electronic Imaging 2002, International Society for Optics and Photonics, 390-401.

[20] Provenzi, E., Gatta, C., Fierro, M. and Rizzi, A. (2008) A spatially variant white-patch and gray-world method for color image enhancement driven by local contrast. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 1757-1770.

[21] McCann, J.J. (2004) Retinex at 40. Journal of Electronic Imaging, 13, 6-145.

[22] John, J. and Wilscy, M. (2008) Enhancement of weather degraded video sequences using wavelet fusion. 7th IEEE International Conference on Cybernetic Intelligent Systems, CIS 2008, London, 9-10 September 2008, 1-6.

[23] 郭璠, 蔡自兴, 谢斌 (2011) 基于雾气理论的视频去雾算法. 电子学报, 9, 2019-2025.

[24] Yoon, I., Kim, S., Kim, D., Hayes, M.H. and Paik, J. (2012) Adaptive defogging with color correction in the HSV color space for consumer surveillance system. IEEE Transactions on Consumer Electronics, 58, 111-116.

[25] 甘佳佳, 肖春霞 (2013) 结合精确大气散射图计算的图像快速去雾. 中国图象图形学报, 5, 583-590.

[26] Lewis, G.R. (1990) Three-axis image stabilization with a two-axis mirror. 33rd Annual Technical Sym-posium, San Diego, 7 August 1990, 309-313.

[27] Balakirsky, S.B. and Chellappa, R. (1996) Performance characte-rization of image stabilization algorithms. International Conference on Image Processing, 1, 413-416.

[28] 王志民, 徐晓刚 (2010) 电子稳像技术综述. 中国图象图形学报, 3, 470-480.

[29] 陈启立, 宋利, 余松煜 (2011) 视频稳像技术综述. 电视技术, 7, 15-17.

[30] Smith, B.M., Zhang, L., Jin, H. and Agarwala, A. (2009) Light field video stabilization. 2009 IEEE 12th International Conference on Computer Vision, Kyoto, 29 September-2 October 2009, 341-348.

[31] Lee, K.Y., Chuang, Y.Y., Chen, B.Y. and Ouhyoung, M. (2009) Video stabilization using robust feature trajectories. 2009 IEEE 12th International Conference on Computer Vision, Kyoto, 29 September-2 October 2009, 1397-1404.

[32] Morimoto, C. and Chellappa, R. (1998) Evaluation of image stabilization algorithms. Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, 5, 2789-2792.

[33] Zhang, G., Hua, W., Qin, X., Shao, Y. and Bao, H. (2009) Video stabilization based on a 3D perspective camera model. The Visual Computer, 25, 997-1008.

[34] Liu, F., Gleicher, M., Wang, J., Jin, H. and Agarwala, A. (2011) Subspace video sta-bilization. ACM Transactions on Graphics (TOG), 30, Article No. 4.

[35] Goldstein, A. and Fattal, R. (2012) Video stabilization using epipolar geometry. ACM Transactions on Graphics (TOG), 31, Article No. 126.

[36] Liu, F., Gleicher, M., Jin, H. and Agarwala, A. (2009) Content-preserving warps for 3D video stabilization. ACM Transactions on Graphics (TOG), 28, 44.

[37] Zhou, Z., Jin, H. and Ma, Y. (2013) Plane-based content preserving warps for video stabilization. 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, 23-28 June 2013, 2299-2306.

[38] Liu, S., Yuan, L., Tan, P. and Sun, J. (2013) Bundled camera paths for video stabilization. ACM Transactions on Gra- phics (TOG), 32, 78.

[39] Lewis, N.W. and Allnatt, J.A. (1965) Subjective quality of television pictures with multiple impairments. Electron Le- tters, 1, 187-188.

[40] Richardson, I.E.G. and Kannangara, C.S. (2004) Fast subjective video quality measurement with user feedback. Electronics Letters, 40, 799-801.

[41] Wang, Z., Sheikh, H.R. and Bovik, A.C. (2003) Objective video quality assessment. In: The Handbook of Video Databases: Design and Applications, 1041-1078.

[42] Ferzli, R. and Karam, L.J. (2009) A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB). IEEE Transactions on Image Processing, 18, 717-728.

[43] Mittal, A., Moorthy, A.K. and Bovik, A.C. (2012) No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing, 21, 4695-4708.

[44] Saad, M.A., Bovik, A.C. and Charrier, C. (2012) Blind image quality assessment: A natural scene statistics approach in the DCT domain. IEEE Transactions on Image Processing, 21, 3339-3352.

[45] 南栋, 毕笃彦, 查宇飞, 张泽, 李权合 (2013) 基于参数估计的无参考型图像质量评价算法. 电子与信息学报, 9, 2066-2072.

[46] Ferzli, R. and Karam, L.J. (2007) A no reference objective shaprness metric using riemannian tensor. Simulation, 1, 1.

[47] Hautiere, N., Tarel, J.P., Aubert, D. and Dumont, E. (2008) Blind contrast enhancement assessment by gradient rati- oing at visible edges. Image Analysis & Stereology Journal, 27, 87-95.

[48] Cohen, E. and Yitzhaky, Y. (2010) No-reference assessment of blur and noise impacts on image quality. Signal, Image and Video Processing, 4, 289-302.

[49] 禹晶, 李大鹏, 廖庆敏 (2011) 基于颜色恒常性的低照度图像视见度增强. 自动化学报, 8, 923-931.

[50] Liu, H. and Heynderickx, I. (2009) A perceptually relevant no-reference blockiness metric based on local image characteristics. EURASIP Journal on Advances in Signal Processing, 2009, 2.

[51] 李大鹏, 禹晶, 肖创柏 (2011) 图像去雾的无参考客观质量评测方法. 中国图象图形学报, 9, 1753-1757.

[52] Niskanen, M., Silvén, O. and Tico, M. (2006) Video stabilization performance assessment. 2006 IEEE International Conference on Multimedia and Expo, Toronto, 9-12 July 2006, 405-408.

[53] 黄晨, 王建军, 高昕, 丁晟 (2013) 电子稳像中稳像质量评价方法研究. 激光与红外, 5, 477-481.

分享
Top