CT-Net, OpenPose, LIP_JPPNet, DensePose running with ncnn⚡服装迁移/虚拟试穿⚡ClothingTransfer/Virtual-Try-On⚡

Related tags

Artificial Intelligence openpose ncnn tryon densepose ctnet lipjppnet
Overview

ClothingMigration-NCNN

What

  1. CT-Net：CVPR2021上的一个虚拟试穿/服装迁移的工作，该工程就是将CT-Net及其相关依赖网络移植到ncnn
  2. 服装迁移：给定一个人的图A，与另一个人的图B，将A的衣服穿到B的身上

PS

这个工作其实我个人计划做的一个系列，分三步：

  1. 仿妆 —— 已完成
  2. 换衣服 —— 已完成，就是该工程
  3. 换发型 —— 计划中

Introduce

这个没啥好说，看图就完事了，先看换男装的： image 再看女装： image 程序流程分析，假定目标服装图A，目标穿衣人B：

  1. 对A与B都应用OpenPose得到candidate和subset
  2. 对A与B都应用JIP_LPPNet得到segment
  3. 对B应用DensePose得到IUV
  4. 对两个candidate、两个subset、两个segment、一个IUV以及图A、B应用CT-Net即可得到换装后的结果

Resource

  1. 上图的集成了所有功能的exe程序，可以从这里，提取码:6666获取，由于一共集成了4个模型，因此非常大，有1个多G，同时运行也很缓慢，大约要一分钟
  2. 该github工程仅包含代码，实际运行调试需要模型，可以从这里，提取码:6666获取，再放到对应的位置就好了
  3. 知乎分析文章

Content

将CVPR2021的服装迁移模型CT-Net搬运至NCNN框架上

CT-Net依赖
  1. 依赖OpenPose的人体姿势——pytorch实现
  2. 依赖LIP_JPPNet的的人体解析分割图——Tensorflow实现
  3. 依赖Densepose的人体IUV图——Detectron2实现
待完成&已完成
  • OpenPose的ncnn&c++实现 —— OpenPose文件夹
  • LIP_JPPNet的ncnn&c++实现 —— LIP_JPPNet文件夹
  • Densepose的ncnn&c++实现 —— DensePose文件夹
  • CT-Net的ncnn&c++实现 —— CT-Net文件夹
  • 组合四个模型的ncnn&c++实现 —— Ensemble文件夹
  • QT GUI实现 —— QT文件夹

Reference

  1. CT-Net
  2. OpenPose
  3. LIP_JPPNet
  4. Densepose
  5. Detectron2
  6. DenseSense
  7. ncnn
  8. opencv-mobile
You might also like...
LibtorchSegmentation - A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.
LibtorchSegmentation - A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.

English | 中文 C++ library with Neural Networks for Image Segmentation based on LibTorch. ⭐ Please give a star if this project helps you. ⭐ The main fea

null 309 Dec 29, 2022
Native runtime package for MediaPipe.NET.

MediaPipe.NET.Runtime Native library package for MediaPipe.NET. This is the first half of the port of MediaPipeUnityPlugin, in order to use MediaPipe

Vignette 14 Oct 12, 2022
GA-NET: Global Attention Network for Point Cloud Semantic Segmentation
GA-NET: Global Attention Network for Point Cloud Semantic Segmentation

GA-NET: Global Attention Network for Point Cloud Semantic Segmentation We propose a global attention network, called GA-Net, to obtain global informat

null 4 Jul 18, 2022
Deep Learning API and Server in C++11 support for Caffe, Caffe2, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

Open Source Deep Learning Server & API DeepDetect (https://www.deepdetect.com/) is a machine learning API and server written in C++11. It makes state

JoliBrain 2.4k Dec 30, 2022
the C++ version of solov2 with ncnn
the C++ version of solov2 with ncnn

the C++ version of SOLOV2 with ncnn

DayBreak 70 Jan 4, 2023
Android hand detect and pose estimation by ncnn
Android hand detect and pose estimation by ncnn

ncnn_nanodet_hand 1.hand detect:用nanode-m训练了个hand detect模型, 2.hand pose:用CMU的数据集训练了个ghostnet作为backbone模仿pfld的handpose模型 3.推理:handpose.cpp单独检测pose，nano

null 80 Jan 3, 2023
Portrait segmentation in your web browser with ncnn and webassembly

ncnn-webassembly-portrait-segmentation open https://nihui.github.io/ncnn-webassembly-portrait-segmentation and enjoy build and deploy Install emscript

null 26 Dec 5, 2022
The SCRFD face detection, depends on ncnn library and opencv
The SCRFD face detection, depends on ncnn library and opencv

The SCRFD face detection, depends on ncnn library and opencv

null 157 Jan 5, 2023
Android face detect and segmentation by ncnn
Android face detect and segmentation by ncnn

Android face detect and segmentation by ncnn

null 118 Dec 29, 2022
Comments
  • ui_mainwindow.h

    ui_mainwindow.h

    Hi, QT\vs2019_ncnn_opencv-mobile_Qt_nanodet， 可以提供 ui_mainwindow.h文件吗？ Ui::MainWindowClass ui; 禁止显示状态 错误(活动) E0135 namespace "Ui" 没有成员 "MainWindowClass"

    谢谢！

    opened by molyswu 3
Owner
WuJinxuan
WuJinxuan
GitHub
This is a sample ncnn android project, it depends on ncnn library and opencv

This is a sample ncnn android project, it depends on ncnn library and opencv

null 248 Jan 6, 2023
GFPGAN-ncnn - a naive NCNN implementation of GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration

GFPGAN-ncnn a naive ncnn implementation of GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration model support: 1.GFPGANClean

FeiGeChuanShu 42 Dec 10, 2022
RealSR-NCNN-Android is a simple Android application that based on Realsr-NCNN & Real-ESRGAN.

RealSR-NCNN-Android Real-ESRGAN is a Practical Algorithms for General Image Restoration. RealSR-NCNN-Android is a simple Android application that base

null 272 Jan 3, 2023
PiDiNet running in Android by ncnn

PiDiNet-NCNN 使用NCNN在安卓上实现PiDiNet这个边缘检测网络。 什么是PiDiNet？指南针：https://github.com/zhuoinoulu/pidinet 文件构成 ncnn-android-nanodet是基于nihui的nanodet项目魔改的，被我改成了运行P

WuJinxuan 9 Dec 13, 2022
monodepth running in Android by ncnn

monodepth-NCNN 将wavelet-monodepth的模型搬运到NCNN上，工程里面给了安卓的工程以及以及生成好的app安装包 wavelet-monodepth wavelet-monodepth：RGB图像的深度估计，wavelet顾名思义，就使用了小波变换的，官方的工程在这：ht

WuJinxuan 14 Aug 13, 2022
YOLOP running in Android by ncnn

YOLOP-NCNN 将YOLOP的模型搬运到NCNN上，工程里面给了windows下的VS测试以及安卓实现 YOLOP YOLOP：车辆检测+路面分割+车道线分割 三合一的网络，基于YOLO系列设计的，官方的工程在这：https://github.com/hustvl/YOLOP 工程细节 VS2

WuJinxuan 34 Dec 28, 2022
A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.

中文 C++ library with Neural Networks for Image Segmentation based on LibTorch. The main features of this library are: High level API (just a line to cr

null 310 Jan 3, 2023
neural net with blackjack and hookers

SkyNet is a light deep learning library. Linux/Windows License ResNet cpp-example for Win Compare with Tensorflow, inference ResNet50. PC: i5-2400, GF

Alexander Medvedev 62 Nov 26, 2022
FG-Net: Fast Large-Scale LiDAR Point Clouds Understanding Network Leveraging Correlated Feature Mining and Geometric-Aware Modelling

FG-Net: Fast Large-Scale LiDAR Point Clouds Understanding Network Leveraging Correlated Feature Mining and Geometric-Aware Modelling Comparisons of Running Time of Our Method with SOTA methods RandLA and KPConv:

Kangcheng LIU 80 Dec 28, 2022
TensorFlow implementation of SQN based on RandLA-Net's encoder

SQN_tensorflow This repo is a TensorFlow implementation of Semantic Query Network (SQN). For Pytorch implementation, check our SQN_pytorch repo. Our i

PointCloudYC 9 Nov 3, 2022