Fast moving objects segmentation algorithm based on boundary searching with convex hull

doi:10.11772/j.issn.1001-9081.2014.10.2976

Abstract

Abstract:

Most of current segmentation algorithms in H.264/AVC compressed domain lose the local Motion Vector (MV) field and have high time complexity because of global motion compensation. A new fast segmentation algorithm, called Convex Hull segmentation in Spatial-Temporal Filter (STF) based on Boundary Search on compressed domain (BS-CHSTF) was proposed. Motion vector field in bit stream was mainly used in this algorithm. Firstly, the STF algorithm was used in preprocessing the MV, and then eight-direction adaptive search algorithm was used to get connected region, which is filled by constructing the convex hull using boundary of the connected region. Afterwards, multiple connected regions were clustered by redefining the distance between connected regions distance. Finally, the motion object segmentation was obtained by optimizing the mask. Compared with Gaussian Mixture Model (GMM) segmentation algorithm and Ant Colony Algorithm (ACA), the experimental results show that the segmentation accuracy is improved about 3% averagely, and even in the case of lack of motion vector field, the segmentation accuracy increased nearly 20%, while the segmentation speed increased an average of nearly 25%. The method focuses on obtaining the moving object quickly with better segmentation accuracy even in the case of Moving Object (MO) uncompleted.

摘要：

目前在H.264/AVC压缩域分割领域中常用方法造成局部运动矢量(MV)缺失，而通过全局运动补偿来还原运动矢量导致其时间复杂度提高。为解决此问题，提出一种基于边界聚类的快速凸壳分割(BS-CHSTF)算法。该方法主要利用码流中的运动矢量场信息进行分割，首先,对MV利用时空域滤波(STF)对运动矢量进行预处理，采用八方向自适应搜索算法进行边界搜索确定运动连通域；然后根据每个连通域边界求解凸壳并对其进行连通域填充，之后利用运动矢量与距离信息设定聚类规则，对多个连通域进行聚类；最后，对其进行优化掩膜达到分割运动对象的效果。实验结果表明，与混合高斯模型(GMM)分割算法和压缩域蚁群算法(ACA)比较，在分割准确率上平均提高了近3%，甚至在运动矢量场严重缺失的情况下，提高了近20%；而在分割速度上平均提高了近25%。该方法着重于求得运动对象的完整性与快速性，在运动对象不完整的情况下，能够获得较好分割精准度。

CLC Number:

TP391.4

QIAN Zenglei LIANG Jiuzhen. Fast moving objects segmentation algorithm based on boundary searching with convex hull[J]. Journal of Computer Applications, 2014, 34(10): 2976-2981.

钱增磊梁久祯. 基于边界搜索的运动对象快速凸壳分割算法[J]. 计算机应用, 2014, 34(10): 2976-2981.

References

［1］AVANUR J. Survey on motion vector filtering and object segmentation methods in compressed domain ［J］. International Journal of Advancements in Technology, 2011,2(2):199-205.
［2］SCHWARZ H, MARPE D, WIEGAND T. Overview of the scalable video coding extension of the H.264/AVC standard ［J］. IEEE Transactions on Circuits and Systems for Video Technology, 2007,17(9):1103-1120.［3］SORWAR G, MURSHED M, DOOLEY L. Fast global motion estimation using iterative least-square estimation technique ［C］ // Proceedings of the 2003 Joint Conference of the Fourth International Conference on Information, Communications and Signal Processing, 2003 and 4th Pacific Rim Conference on Multimedia. Piscataway: IEEE Press, 2003,1:282-286.
［4］AHMAD A M A, CHEN D Y, LEE S Y. Robust object detection using cascade filter in MPEG videos ［C］// Proceedings of the 2003 5th International Symposium on Multimedia Software Engineering. Piscataway: IEEE Press, 2003:196-203.
［5］MOURA R C, HEMERLY E M. A spatiotemporal motion-vector filter for object tracking on compressed video ［C］// Proceedings of the 2010 Seventh IEEE International Conference on Advanced Video and Signal Based Surveillance. Piscataway: IEEE Press, 2010:427-434.
［6］VENKATESH BABU R, RAMAKRISHNAN K R. Compressed domain motion segmentation for video object extraction ［C］// Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing. Piscataway: IEEE Press, 2002,4:3788-3791.
［7］PORIKLI F, BASHIR F, SUN H. Compressed domain video object segmentation ［J］. IEEE Transactions on Circuits and Systems for Video Technology, 2010,20(1):2-14.
［8］BASHIR F, PORIKLI F. Performance evaluation of object detection and tracking systems ［C］// Proceedings of the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance. Piscataway: IEEE Press, 2006:5.
［9］ZENG W, DU J, GAO W, et al.Robust moving object segmentation on H.264/AVC compressed video using the block-based MRF model ［J］. Real-Time Imaging, 2005,11(4):290-299.
［10］SOLANA-CIPRES C, RODRIGUEZ-BENITEZ L, MORENO-GARCIA J, et al.Real-time segmentation of moving objects in H.264 compressed domain with dynamic design of fuzzy sets［J］. Vectors, 2009,4(4):16.
［11］WANG P, WU Z. Moving object segmentation in H.264/AVC compressed domain using ant colony algorithm ［C］// Proceedings of the 2010 2nd International Conference on Signal Processing Systems. Piscataway: IEEE Press, 2010,2:716-719.
［12］DEVI K S, MALMURUGAN N, AMBIKA H. Moving region segmentation from compressed video using global motion estimation by macroblock classification and Markov random field model ［C］// Proceedings of the 2013 International Conference on Emerging Trends in Computing, Communication and Nanotechnology. Piscataway: IEEE Press, 2013:163-167.
［13］LU Y, XU X. Efficient object segmentation using background estimation for H.264 video ［C］// Proceedings of the 2012 8th International Conference on Wireless Communications, Networking and Mobile Computing. Piscataway: IEEE Press, 2012:1-4.
［14］SUN L, DAI M, CHEN X. A simple and fast moving object segmentation based on H.264 compressed domain information ［C］// Proceedings of the 2012 4th International Conference on Computational and Information Sciences. Piscataway: IEEE Press, 2012:481-484.
［15］ZHANG D, JAVED O, SHAH M. Video object segmentation through spatially accurate and temporally dense extraction of primary object regions ［C］// Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2013:628-635.
［16］WANG P, WANG J. Particle swarm clustering-based moving object segmentation in the H.264 compressed domain ［J］. Advanced Materials Research, 2012,433:4841-4844.
［17］ANDREWS S, MCINTOSH C, HAMAMEH G. Convex multi-region probabilistic segmentation with shape prior in the isometric log-ratio transformation space ［C］// Proceedings of the 2011 IEEE International Conference on Computer Vision. Piscataway: IEEE Press, 2011:2096-2103.
［18］GALASSO F, NAGARAJA N S, CARDENAS T J, et al.A unified video segmentation benchmark: annotation, metrics and analysis ［C］// Proceedings of the IEEE International Conference on Computer Vision. Piscataway: IEEE Press, 2013:3527-3534.
［19］LEE Y J, KIM J, GRAUMAN K. Key-segments for video object segmentation ［C］// Proceedings of the 2011 IEEE International Conference on Computer Vision. Piscataway: IEEE Press, 2011:1995-2002.

[1]	. Pavement defect detection algorithm with enhanced morphological perception [J]. Journal of Computer Applications, 0, (): 0-0.
[2]	YANG Jianfeng, CHEN Bin, LI Yuxuan. Self-supervised point cloud anomaly detection method based on point cloud reconstruction [J]. Journal of Computer Applications, 0, (): 0-0.
[3]	. Binocular vision object location algorithm for robot arm grasping [J]. Journal of Computer Applications, 0, (): 0-0.
[4]	. Multi-attention contrastive learning for infrared small target detection [J]. Journal of Computer Applications, 0, (): 0-0.
[5]	LI Zhonghua, ZHONG Gengxin, FAN Ping, ZHU Hengliang. Camouflaged object detection by boundary mining and background guidance [J]. Journal of Computer Applications, 0, (): 0-0.
[6]	. Multi-view difficult airway recognition based on discriminant region guidance [J]. Journal of Computer Applications, 0, (): 0-0.
[7]	. Privacy preserving localization of surveillance images based on large vision models [J]. Journal of Computer Applications, 0, (): 0-0.
[8]	. Data augmentation method for abnormal passenger behavior in elevators based on dynamic graph convolutional network [J]. Journal of Computer Applications, 0, (): 0-0.
[9]	. Text-based person retrieval method based on multi-granularity shared semantic center association [J]. Journal of Computer Applications, 0, (): 0-0.
[10]	. Distribution adaptation and dynamic curriculum pseudo-labeling framework for semi-supervised fire detection [J]. Journal of Computer Applications, 0, (): 0-0.
[11]	. Image Caption Method Based on Swin-Transformer and Multi-Scale Feature Fusion [J]. Journal of Computer Applications, 0, (): 0-0.
[12]	Wei XIONG, Yibo CHEN, Lizhen ZHANG, Qian YANG, Qin ZOU. Self-supervised monocular depth estimation using multi-frame sequence images [J]. Journal of Computer Applications, 2024, 44(12): 3907-3914.
[13]	Keyi FU, Gaocai WANG, Man WU. Few-shot object detection method based on improved region proposal network and feature aggregation [J]. Journal of Computer Applications, 2024, 44(12): 3790-3797.
[14]	Chenghao YANG, Jie HU, Hongjun WANG, Bo PENG. Incomplete multi-view clustering algorithm based on attention mechanism [J]. Journal of Computer Applications, 2024, 44(12): 3784-3789.
[15]	Peng FANG, Fan ZHAO, Baoquan WANG, Yi WANG, Tonghai JIANG. Development， technologies and applications of blockchain 3.0 [J]. Journal of Computer Applications, 2024, 44(12): 3647-3657.