[1]杨天成,杨建红,陈伟鑫.图像抠图与copy-paste结合的数据增强方法[J].华侨大学学报(自然科学版),2023,44(2):243-249.[doi:10.11830/ISSN.1000-5013.202209025]
 YANG Tiancheng,YANG Jianhong,CHEN Weixin.Data Enhancement Method Combining Image Matting and Copy-Paste[J].Journal of Huaqiao University(Natural Science),2023,44(2):243-249.[doi:10.11830/ISSN.1000-5013.202209025]
点击复制

图像抠图与copy-paste结合的数据增强方法()
分享到:

《华侨大学学报(自然科学版)》[ISSN:1000-5013/CN:35-1079/N]

卷:
第44卷
期数:
2023年第2期
页码:
243-249
栏目:
出版日期:
2023-03-14

文章信息/Info

Title:
Data Enhancement Method Combining Image Matting and Copy-Paste
文章编号:
1000-5013(2023)02-0243-07
作者:
杨天成 杨建红 陈伟鑫
华侨大学 机电及自动化学院, 福建 厦门 361021
Author(s):
YANG Tiancheng YANG Jianhong CHEN Weixin
College of Mechanical Engineering and Automation, Huaqiao University, Xiamen 361021, China
关键词:
数据增强 图像抠图 copy-paste 实例分割
Keywords:
data enhancement image matting copy-paste instance segmentation
分类号:
TP274;TP183
DOI:
10.11830/ISSN.1000-5013.202209025
文献标志码:
A
摘要:
提出一种基于图像抠图与copy-paste结合的数据增强方法(matting-paste),采用图像抠图法获取单个垃圾实例的准确轮廓,并对单个实例进行旋转和亮度变换.根据物体轮廓信息,把实例粘贴到背景图上,无需额外的人工标注即可生成新的带有标注的数据,从而提高数据集的多样性和复杂性.结果表明:数据集扩充后的mask比数据集扩充前的识别精度提高了0.039,matting-paste能在已有数据集上有效地扩充数据,进一步提高模型的识别精度.
Abstract:
A data enhancement method(matting-paste)based on image matting and copy-paste is proposed. Using the image matting method to obtain the precise contour of a single waste instance, and rotation and brightness transformation are carried out for each instance. Instances are pasted onto the background image according to the object’s contour information, and new annotated data can be generated without additional manual annotation, which improves the diversity and complexity of the dataset. The results show that the recognition precision of mask after dataset augmentation is improved 0.039 compared with before dataset augment. Matting-paste can effectively augment the data and further improve the the recognition precision of the model.

参考文献/References:

[1] GUNDUPALLI S P,HAIT S,THAKUR A.A review on automated sorting of source-separated municipal solid waste for recycling[J].Waste Management,2017,60:56-74.DOI:10.1016/j.wasman.2016.09.015.
[2] SEIKE T,ISOBE T,HARADA Y,et al.Analysis of the efficacy and feasibility of recycling PVC sashes in Japan[J].Resources, Conservation and Recycling,2018,131:41-53.DOI:10.1016/j.resconrec.2017.12.003.
[3] ZHANG Qiang,YANG Qifan,ZHANG Xujuan,et al.A multi-label waste detection model based on transfer learning[J].Resources, Conservation and Recycling,2022,181:106235.DOI:10.1016/j.resconrec.2022.106235.
[4] SOUSA J,REBELO A,CARDOSO J S.Automation of waste sorting with deep learning[C]//2019 XV Workshop de Vis?o Computacional.Brazi:IEEE Press,2019:43-48.DOI:10.1109/WVC.2019.8876924.
[5] LI Jiantao,FANG Huaiying,FAN Lulu,et al.RGB-D fusion models for construction and demolition waste detection[J].Waste Management,2022,139:96-104.DOI:10.1016/j.wasman.2021.12.021.
[6] HAFIZ A M,BHAT G M.A survey on instance segmentation: State of the art[J].International Journal of multimedia Information Retrieval,2020,9(3):171-189.DOI:10.1007/s13735-020-00195-x.
[7] LIN T Y,MAIRE M,BELONGIE S,et al.Microsoft coco: Common objects in context[C]//European Conference on Computer vision.[S.l.]:Springer,2014:740-755.DOI:10.1007/978-3-319-10602-1_48.
[8] SHORTEN C,KHOSHGOFTAAR T M.A survey on image data augmentation for deep learning[J].Journal of Big Data,2019,6(1):1-48.DOI:10.1186/s40537-019-0197-0.
[9] GHIASI G,CUI Yin,SRINIVAS A,et al.Simple copy-paste is a strong data augmentation method for instance segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.[S.l.]:IEEE Press,2021:2918-2928.
[10] MINAEE S,BOYKOV Y Y,PORIKLI F,et al.Image segmentation using deep learning: A survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,44(7):3523-3542.DOI:10.1109/TPAMI.2021.3059968.
[11] HE Kaiming,GKIOXARI G,DOLLáR P,et al.Mask r-cnn[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2017:2961-2969.DOI:10.48550/arXiv.1703.06870.
[12] KE Lei,DANELLJAN M,LI Xia,et al.Mask transfiner for high-quality instance segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Orleans:IEEE Press,2022:4412-4421.DOI:10.48550/arXiv.2111.13673.
[13] KE Zhanghan,SUN Jiayu,LI Kaican,et al.Modnet: Real-time trimap-free portrait matting via objective decomposition[C]//Proceedings of the AAAI Conference on Artificial Intelligence.[S.l.]:AAAI Press,2022,36(1):1140-1147.DOI:10.1609/aaai.v36i1.19999.
[14] QIAO Yu, LIU Yuhao, YANG Xin, et al.Attention-guided hierarchical structure aggregation for image matting[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.[S.l.]:IEEE Press,2020:13676-13685.
[15] MA Yuhui.Changing tetra pak: From waste to resource[J].Science Progress,2018,101(2):161-170.DOI:10.3184/003685018X15215434299329.
[16] LIN T Y,DOLLáR P,GIRSHICK R,et al.Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Honolulu:IEEE Press,2017:2117-2125.
[17] VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[J].Advances in Neural Information Processing Systems,2017,30:1-15.
[18] WANG Jue,COHEN M F.Image and video matting: A survey[J].Foundations and Trends in Computer Graphics and Vision,2008,3(2):97-175.DOI:10.1561/0600000019.
[19] HE Kaiming,ZHANG Xiangyu,REN Shaoqing,et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE Press,2016:770-778.

备注/Memo

备注/Memo:
收稿日期: 2022-09-25
通信作者: 杨建红(1974-),男,教授,博士,主要从事多模态视觉检测方法及系统开发、基于多平台的机器深度学习算法、高效率智能分选机器人的研究.E-mail:yjhong@hqu.edu.cn.
基金项目: 福建省科技重大专项(2020YZ017022); 福建省厦门市科技计划项目(2021FCX012501190024); 深圳市科技计划项目(JSGG20201103100601004)
更新日期/Last Update: 2023-03-20