VNN是由欢聚集团(Joyy Inc.)推出的高性能、轻量级神经网络部署框架。目前已为Hago、VOO、VFly、马克相机等App提供20余种AI能力的支持,覆盖直播、短视频、视频编辑等泛娱乐场景和工程场景

Overview

Logo

简介

VNN是由欢聚集团(Joyy Inc.)推出的高性能、轻量级神经网络部署框架。目前已为HagoVOOVflyCloudVfly马克水印相机等App提供20余种AI能力的支持,覆盖直播、短视频、视频编辑等泛娱乐场景和工程场景

特性

  • 免费:无授权控制,无广告植入
  • 安全:零权限需求
  • 跨平台一致设计和体验:良好支持Andorid/iOS系统平台, 即将支持Windows/MacOS/Linux系统平台
  • 轻盈:全部功能SDK打包体积 Andorid 2.3M(arm64), iOS 2.0M(arm64)
  • 易用:API风格简洁、统一

支持能力

ability


人脸关键点

face_Img face_keypoints face_Img face278
原图 人脸关键点 美颜 动态效果

指标对比

face104compare face278compare

各功能效果展示

disney_example 3dgame_example comic_example
迪士尼人脸风格化 3D游戏人脸风格化 油画图像风格化
portrait_segment_example animal_segment_example sky_segment_example
人像分割 动物分割 天空分割
clothes_segment_example animal_segment_example face_reenactment_example
衣物分割(换色) 头发分割(换色) 人脸表情驱动

Demo体验

Android Demo APK
Android Demo工程
iOS Demo工程


集成指引与SDK文档

Android集成指引
iOS集成指引
SDK文档索引
常见问题


更新计划

  • 2021.12.15 支持 Windows/MacOS 平台
  • 2021.12.30 支持 Linux 平台
  • 2022.01.15 新增人体关键点检测(Pose Detection)SDK
  • 发布模型转换工具链以及模型调用接口
  • 发布libs核心源代码

License

MIT


注明

如果有商用或使用问题可以随时联系我们:
[email protected], [email protected], [email protected], [email protected]

Issues
  • Android demo is giving issue at compiling

    Android demo is giving issue at compiling

    /src/main/cpp/vnnjni.cpp:59: undefined reference to `VNN_Destroy_Face'

    /src/main/cpp/vnnjni.cpp:1197: undefined reference to `VNN_Destroy_ObjCount'

    ./../src/main/cpp/vnnjni.cpp:1313: undefined reference to `VNN_Destroy_DocRect'

    Can I know a specific version of the CMake tool and NDK version which is used at the time of compiling demos

    opened by soham24 6
  • update libraries of android and ios, update android demo, add license declaration

    update libraries of android and ios, update android demo, add license declaration

    1. update libraries on android and ios, fix bugs in face parser and stylizing.
    2. update android demo, support video portrait segment, support image mode of disney face and 3d game face.
    3. add license declaration to source files in demos of different platforms
    opened by mrbrantofgithub 0
  • update libraries on android and ios

    update libraries on android and ios

    1. fix bugs in face parser and stylizing applications.
    2. update android demo, support video portrait segment, support image mode of disney face and 3d game.
    3. add license declaration to source files in demos of different platforms.
    opened by mrbrantofgithub 0
  • upload libraries, demos on windows and macos

    upload libraries, demos on windows and macos

    1. upload libraries, demos on windows and macos.
    2. update face_count[1.0.0].vnnmodel, qrcode_detection[1.0.0].vnnmodel, old models can not run on pc.
    3. modify readme.
    opened by mrbrantofgithub 0
  • How do we achieve a .vnnmodel from pretrained models..in say...  t7 pth h5 onnx format?

    How do we achieve a .vnnmodel from pretrained models..in say... t7 pth h5 onnx format?

    Hi..great app!! Would love to know how to get models into .vnnmodel format so i can use custom trained models..that would be a great extra..as any search into .vnnmodel yields a search result of..u.

    opened by djwugee 0
  • Nice!! 期待开放GPU接口~

    Nice!! 期待开放GPU接口~

    public static class VNN_Image { public long ori_fmt; /* orientation format enum of img*/ public int pix_fmt; /* pixel format enum of img / public int mode_fmt; / mode format enum of detection, can use video/picture/default / public int width; //image width public int height; //image height public int channels; //image channel public byte[] data; //cpu data public float[] rect; public int[] texture; / if is cpu-backend, texture is NULL. But if is gpu-backend, texture may be a VNN_Texture(android|ios) or a CVPixelbuffer(ios). */ }

    opened by HuangGY1993 0
MINCE is an Emacs-like text editor from Mark of the Unicorn, Inc.

MINCE Is Not Complete[ly] EMACS Overview MINCE is an Emacs-like text editor from Mark of the Unicorn, Inc. Versions were available for many oper

Jeffrey H. Johnson 20 May 17, 2022
A non-linear trajectory optimization library developed by Optimus Ride, Inc

A non-linear trajectory optimization library developed by Optimus Ride, Inc. This library implements a C++ version of the original open-source ALTRO solver developed by the Robotic Exploration Lab at Stanford and Carnegie Mellon Universities, also available open-source as an official Julia package.

Optimus Ride 41 Jun 7, 2022