Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (2): 504-510.DOI: 10.11772/j.issn.1001-9081.2020050626

Special Issue: 多媒体计算与计算机仿真

• Multimedia computing and computer simulation • Previous Articles     Next Articles

Low-poly rendering for image and video

HAN Yanru1, YIN Mengxiao1,2, QIN Zixuan1, SU Peng1, YANG Feng1,2   

  1. 1. School of Computer, Electronics and Information, Guangxi University, Nanning Guangxi 530004, China;
    2. Guangxi Key Laboratory of Multimedia Communications and Network Technology(Guangxi University), Nanning Guangxi 530004, China
  • Received:2020-05-12 Revised:2020-08-03 Online:2021-02-10 Published:2020-08-26
  • Supported by:
    This work is partially supported by the National Natural Science Foundation of China (61762007, 61861004), the Natural Science Foundation of Guangxi (2017GXNSFAA198269, 2017GXNSFAA198267).

图像和视频的低多边形渲染

韩艳茹1, 尹梦晓1,2, 覃子轩1, 苏鹏1, 杨锋1,2   

  1. 1. 广西大学 计算机与电子信息学院, 南宁 530004;
    2. 广西多媒体通信与网络技术重点实验室(广西大学), 南宁 530004
  • 通讯作者: 尹梦晓
  • 作者简介:韩艳茹(1992-),女,山西朔州人,硕士研究生,主要研究方向:图像和视频处理;尹梦晓(1978-),女,河南南阳人,副教授,博士,CCF会员,主要研究方向:计算机图形学、数字几何处理、图像和视频编辑;覃子轩(1995-),男,广西南宁人,硕士研究生,主要研究方向:视觉SLAM;苏鹏(1987-),男,黑龙江哈尔滨人,硕士研究生,主要研究方向:计算机图形学;杨锋(1979-),男,广西玉林人,副教授,博士,CCF会员,主要研究方向:医学图像处理、人工智能。
  • 基金资助:
    国家自然科学基金资助项目(61762007, 61861004);广西自然科学基金资助项目(2017GXNSFAA198269,2017GXNSFAA198267)。

Abstract: Low-poly is a popular style in the art design field recently. In order to improve the quality of image and video low-poly stylization, an image and video low-poly rendering method based on edge features and superpixel segmentation was proposed. Firstly, the intersection points of adjacent superpixels and the uniform sampling points of the difference set between feature edges and superpixel boundaries were extracted as the vertices of the triangle mesh, and Delaunay triangulation was performed to generate the initial triangle mesh. Then, the constrained quadric error metric method was used to simplify the generated mesh in order to generate the final triangle mesh. Finally, the triangle mesh was filled with color to obtain the image with low-poly style. For video low-poly rendering, the temporally consistent superpixels were used to track the same part of the object across frames to establish associations between the video frames, reducing the jitter after video rendering. In addition, the video segmentation method was used to segment the moving objects in the video, so as to obtain sampling points with different densities between the moving objects and the background, and the local stylized effect of the video was obtained by rendering the moving objects. Experimental results show that the proposed method can generate low-poly rendering results with better visual effects.

Key words: triangulation, temporally consistent superpixel, edge feature, low-poly rendering, uniform sampling

摘要: 低多边形是近来艺术设计界的热门风格。为了提高图像和视频低多边形风格化的质量,提出一种基于边缘特征和超像素分割的图像和视频低多边形渲染方法。首先提取相邻超像素的交点以及对特征边和超像素边界的差集的均匀采样点作为三角网格顶点,并执行Delaunay三角剖分来生成初始三角网格;然后采用带约束的二次误差度量方法对生成的网格进行简化,以生成最终三角网格;最后对三角网格填充颜色,得到了具有低多边形风格的图像。对于视频低多边形渲染,使用时间一致性超像素跨帧跟踪同一对象的相同部分,以建立视频帧之间的关联,降低视频渲染后的抖动。此外,采用视频分割方法分割视频中的移动对象,获得移动对象与背景之间不同密度的采样点,对移动对象进行渲染获从而得到视频的局部风格化效果。实验结果表明,所提方法能够生成具有较好视觉效果的低多边形渲染结果。

关键词: 三角剖分, 时间一致性超像素, 边缘特征, 低多边形渲染, 均匀采样

CLC Number: