VST/AU Plugin for Auditioning RAVE Models in Real-time

Overview

rave_audition

RAVE-audition

VST/AU Plugin for Auditioning RAVE Models in Real-time

Check out Antoine's great work in the original RAVE repository!

Building the C++ project

  • Add Juce 6.1.4 as a directory called JUCE in the main working directory or clone the repository.
    • ln -s <JUCE-DIR> . OR
    • git clone --depth 1 --branch 6.1.4 https://github.com/juce-framework/JUCE
  • Use cmake to build. Tested with cmake 3.21.3, clang 11.0.3, Xcode 11.7 on MacOS 10.15.7. This will download the PyTorch libraries.
    • mkdir build; cd build
    • cmake .. -DCMAKE_BUILD_TYPE=Release
    • cmake --build . --config Release -j 4 or cmake -G Xcode -B build

Prebuilt Plugins

Coming soon!

Caveats

The plugin currently has a memory leak

You might also like...
A real-time LiDAR SLAM package that integrates TLOAM and ScanContext.

SC-TLOAM What is SC-TLOAM? A real-time LiDAR SLAM package that integrates TLOAM and ScanContext. TLOAM for odometry. ScanContext for coarse global loc

[CVPR 2021] NormalFusion: Real-Time Acquisition of Surface Normals for High-Resolution RGB-D Scanning

NormalFusion: Real-Time Acquisition of Surface Normals for High-Resolution RGB-D Scanning Project Page | Paper | Supplemental material #1 | Supplement

 Real-time LiDAR SLAM: Scan Context (18 IROS) + LeGO-LOAM (18 IROS)
Real-time LiDAR SLAM: Scan Context (18 IROS) + LeGO-LOAM (18 IROS)

SC-LeGO-LOAM NEWS (Nov, 2020) A Scan Context integration for LIO-SAM, named SC-LIO-SAM (link), is also released. Real-time LiDAR SLAM: Scan Context (1

Real-time object detection with YOLOv5 and TensorRT

YOLOv5-TensorRT The goal of this library is to provide an accessible and robust method for performing efficient, real-time inference with YOLOv5 using

 Real-time Skeletonization for Sketch-based Modeling (SMI:2021)
Real-time Skeletonization for Sketch-based Modeling (SMI:2021)

Real-time Skeletonization for Sketch-based Modeling (SMI:2021) Demo We provide an executable software under directory "demo_exe/". Tested Environment

Real-Time Neural 3D Hand Pose Estimation from an Event Stream [ICCV 2021]

EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Stream Project Page Index TRAIN.md -- how to train the model from scratch EVAL_REAL

A lightweight 2D Pose model  can be deployed on Linux/Window/Android, supports CPU/GPU inference acceleration, and can be detected in real time on ordinary mobile phones.
A lightweight 2D Pose model can be deployed on Linux/Window/Android, supports CPU/GPU inference acceleration, and can be detected in real time on ordinary mobile phones.

A lightweight 2D Pose model can be deployed on Linux/Window/Android, supports CPU/GPU inference acceleration, and can be detected in real time on ordinary mobile phones.

ROS wrapper for real-time incremental event-based vision motion estimation by dispersion minimisation
ROS wrapper for real-time incremental event-based vision motion estimation by dispersion minimisation

event_emin_ros ROS wrapper for real-time incremental event-based vision motion estimation by dispersion minimisation (EventEMin). This code was used t

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Project DeepSpeech DeepSpeech is an open-source Speech-To-Text engine, using a model trained by machine learning techniques based on Baidu's Deep Spee

Comments
  • MacOS build problems

    MacOS build problems

    Thanks for sharing this great repo. With my limited experience with cmake, I get into some trouble building with cmake and xcode when in the build folder, I first run the two commands mkdir build; cd build cmake .. -DCMAKE_BUILD_TYPE=Release, and then with the next I get an error :

    cmake -G Xcode -B build

    CMake Error: The source directory "/Users/espensommereide/Documents/github/RAVE-audition/build" does not appear to contain CMakeLists.txt.

    So I have tried to add .. to get the CMakeLists file but still seems to be problems with the folder structure, like a doubling of build folders. Any hints as to what is the best way of doing this?

    opened by materialvision 1
  • Successful Linux build

    Successful Linux build

    So I found a way to make it work when using linux (Fedora 33, Cmake 3.19.7, GCC 10.3.1)

    I did not build the AU version, as I did not need it and was stopping the build:

    CMake Error at CMakeLists.txt:164 (target_sources):
      Cannot specify sources for target "rave-audition_AU" which is not built by
      this project.
    

    So I removed the "AU" from line 98 of the CMakeLists.txt file

    I then had linking problems as the libraries are specified for MacOS

    For linux change all the .dylib to .so from line 157 to 160 of the CMakeLists.txt file This works for libtorch.so but you'll need to dowload the others from the MKL library repository (got the link from here) https://github.com/01org/mkl-dnn/releases/download/v0.9/mklml_lnx_2018.0.20170425.tgz

    Unpack the archive, go to /lib and move all the .so to RAVE-audition/build/torch/libtorch/lib/

    Now you should be able to build:

    mkdir build; cd build
    cmake .. -DCMAKE_BUILD_TYPE=Release
    cmake --build . --config Release -j 4
    

    The resulting files are in: RAVE-audition/build/rave-audition_artefacts/Release

    If you get

    ./RAVE Audition: error while loading shared libraries: 
    libtorch.so: cannot open shared object file: No such file or directory
    

    you need to add the libtorch.so path to your system path.

    Do this by adding this line to your ~/.bashrc: export LD_LIBRARY_PATH={LIBTORCH_FOLDER_PATH}:$LD_LIBRARY_PATH

    And update your terminal env variables with source ~/.bashrc

    opened by ZodiacFRA 0
Owner
Andrew Fyfe
Andrew Fyfe
Real time monaural source separation base on fully convolutional neural network operates on Time-frequency domain.

Real time monaural source separation base on fully convolutional neural network operates on Time-frequency domain.

James Fung 108 Dec 4, 2022
Anomaly Detection on Dynamic (time-evolving) Graphs in Real-time and Streaming manner

Anomaly Detection on Dynamic (time-evolving) Graphs in Real-time and Streaming manner. Detecting intrusions (DoS and DDoS attacks), frauds, fake rating anomalies.

Stream-AD 695 Nov 27, 2022
NCNN implementation of Real-ESRGAN. Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Real-ESRGAN ncnn Vulkan This project is the ncnn implementation of Real-ESRGAN. Real-ESRGAN ncnn Vulkan heavily borrows from realsr-ncnn-vulkan. Many

Xintao 538 Dec 2, 2022
🐸 Coqui STT is an open source Speech-to-Text toolkit which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers

Coqui STT ( ?? STT) is an open-source deep-learning toolkit for training and deploying speech-to-text models. ?? STT is battle tested in both producti

Coqui.ai 1.6k Nov 29, 2022
OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Build Type Linux MacOS Windows Build Status OpenPose has represented the first real-time multi-person system to jointly detect human body, hand, facia

null 25.4k Nov 27, 2022
⚡️Real-time portrait segmentation

ncnn-portrait-segmentation ⚡️ Real-time portrait segmentation This project provides real-time human segmentation based on CPU. Requirements ncnn openc

Youngsoo Lee 37 Oct 27, 2022
NCNN+Int8+YOLOv4 quantitative modeling and real-time inference

NCNN+Int8+YOLOv4 quantitative modeling and real-time inference

pengtougu 19 Sep 13, 2022
Python and C++ implementation of "MarkerPose: Robust real-time planar target tracking for accurate stereo pose estimation". Accepted at LXCV Workshop @ CVPR 2021.

MarkerPose: Robust Real-time Planar Target Tracking for Accurate Stereo Pose Estimation This is a PyTorch and LibTorch implementation of MarkerPose: a

Jhacson Meza 47 Nov 18, 2022
DeepRTS is a high-performance Real-TIme strategy game for Reinforcement Learning research written in C++

DeepRTS is a high-performance Real-TIme strategy game for Reinforcement Learning research. It is written in C++ for performance, but provides an python interface to better interface with machine-learning toolkits. Deep RTS can process the game with over 6 000 000 steps per second and 2 000 000 steps when rendering graphics. In comparison to other solutions, such as StarCraft, this is over 15 000% faster simulation time running on Intel i7-8700k with Nvidia RTX 2080 TI.

Centre for Artificial Intelligence Research (CAIR) 152 Oct 17, 2022
A real-time LiDAR SLAM package that integrates FLOAM and ScanContext.

SC-FLOAM What is SC-FLOAM? A real-time LiDAR SLAM package that integrates FLOAM and ScanContext. FLOAM for odometry (i.e., consecutive motion estimati

Jinlai Zhang 14 Nov 9, 2022