A Deep Learning Algorithm for KOL Segmentation on Social Media Videos
Date
Authors
Supervisor
Item type
Journal Article
Degree name
Journal Title
Journal ISSN
Volume Title
Publisher
World Scientific Pub Co Pte Ltd
Abstract
Nowadays, there is high commercial demand for product replacement which places the products virtually in Key Opinion Leader's (KOL's) social media videos. However, one of the challenges of placing the products virtually is the KOL segmentation. Since KOLs often hold products in front of them, it requires the segmentation to segment not only humans but also different products. This paper introduces the state-of-The-Art deep learning method, namely RSUDISNet, for KOL segmentation. The proposed technique integrates two deep Convolutional Neural Network (CNN) technologies. One is the Matting Objective Decomposition Network (MODNet), which segments KOLs well but not the products blocking the KOLs. The other one is the two-level nested U-structure network (U2Net) based on the salient object detection method to segment the objects well, but not the KOL. The key technique of the proposed research is to employ the feature of the U2Net to embed the MODNet to overcome the problem of KOL segmentation. Since both MODNet and U2Net are lightweights, the combined network can be used for real-Time scenarios. After that, the Intermediate Supervision (IS) training strategy is utilized to overcome the overfitting. The experimental results show that our proposed method outperforms the MODNet and U2Net.Description
Keywords
4605 Data Management and Data Science, 46 Information and Computing Sciences, Networking and Information Technology R&D (NITRD), Machine Learning and Artificial Intelligence, 0801 Artificial Intelligence and Image Processing, 1702 Cognitive Sciences, Artificial Intelligence & Image Processing, 4602 Artificial intelligence, 4603 Computer vision and multimedia computation, 4611 Machine learning
Source
International Journal of Pattern Recognition and Artificial Intelligence, ISSN: 0218-0014 (Print); 1793-6381 (Online), World Scientific Pub Co Pte Ltd, 38(15), 2452028-. doi: 10.1142/S0218001424520281
Publisher's version
Rights statement
This work is licensed under a Creative Commons Attribution 4.0 International License.
https://creativecommons.org/licenses/by-nc-nd/4.0/