Thrust: Code at the speed of light
Thrust is a C++ parallel programming library which resembles the C++ Standard Library. Thrust's high-level interface greatly enhances programmer productivity while enabling performance portability between GPUs and multicore CPUs. Interoperability with established technologies (such as CUDA, TBB, and OpenMP) facilitates integration with existing software. Develop high-performance applications rapidly with Thrust!
Thrust is included in the NVIDIA HPC SDK and the CUDA Toolkit.
Quick Start
Getting the Thrust Source Code
The CUDA Toolkit provides a recent release of the Thrust source code in include/thrust. This will be suitable for most users.
Users that wish to contribute to Thrust or try out newer features should recursively clone the Thrust Github repository:
git clone --recursive https://github.com/NVIDIA/thrust.git
Using Thrust From Your Project
Thrust is a header-only library; there is no need to build or install the project unless you want to run the Thrust unit tests.
For CMake-based projects, we provide a CMake package for use with find_package. See the CMake README for more information. Thrust can also be added via add_subdirectory or tools like the CMake Package Manager.
For non-CMake projects, compile with:
- The Thrust include path (
-I<thrust repo root>) - The CUB include path, if using the CUDA device system (
-I<thrust repo root>/dependencies/cub/) - By default, the CPP host system and CUDA device system are used. These can be changed using compiler definitions:
-DTHRUST_HOST_SYSTEM=THRUST_HOST_SYSTEM_XXX, whereXXXisCPP(serial, default),OMP(OpenMP), orTBB(Intel TBB)-DTHRUST_DEVICE_SYSTEM=THRUST_DEVICE_SYSTEM_XXX, whereXXXisCPP,OMP,TBB, orCUDA(default).
Examples
Thrust is best explained through examples. The following source code generates random numbers serially and then transfers them to a parallel device where they are sorted.
#include <thrust/host_vector.h>
#include <thrust/device_vector.h>
#include <thrust/generate.h>
#include <thrust/sort.h>
#include <thrust/copy.h>
#include <algorithm>
#include <cstdlib>
int main(void)
{
// generate 32M random numbers serially
thrust::host_vector<int> h_vec(32 << 20);
std::generate(h_vec.begin(), h_vec.end(), rand);
// transfer data to the device
thrust::device_vector<int> d_vec = h_vec;
// sort data on the device (846M keys per second on GeForce GTX 480)
thrust::sort(d_vec.begin(), d_vec.end());
// transfer data back to host
thrust::copy(d_vec.begin(), d_vec.end(), h_vec.begin());
return 0;
}
This code sample computes the sum of 100 random numbers in parallel:
#include <thrust/host_vector.h>
#include <thrust/device_vector.h>
#include <thrust/generate.h>
#include <thrust/reduce.h>
#include <thrust/functional.h>
#include <algorithm>
#include <cstdlib>
int main(void)
{
// generate random data serially
thrust::host_vector<int> h_vec(100);
std::generate(h_vec.begin(), h_vec.end(), rand);
// transfer to device and compute sum
thrust::device_vector<int> d_vec = h_vec;
int x = thrust::reduce(d_vec.begin(), d_vec.end(), 0, thrust::plus<int>());
return 0;
}
Additional usage examples can be found in the examples/ and testing/ directories of the Github repo.
Documentation Resources
CI Status
Supported Compilers
Thrust is regularly tested using the specified versions of the following compilers. Unsupported versions may emit deprecation warnings, which can be silenced by defining THRUST_IGNORE_DEPRECATED_COMPILER during compilation.
- NVCC 11.0+
- NVC++ 20.9+
- GCC 5+
- Clang 7+
- MSVC 2019+ (19.20/16.0/14.20)
Releases
Thrust is distributed with the NVIDIA HPC SDK and the CUDA Toolkit in addition to GitHub.
See the changelog for details about specific releases.
| Thrust Release | Included In |
|---|---|
| 1.15.0 | TBD |
| 1.14.0 | NVIDIA HPC SDK 21.9 |
| 1.13.1 | CUDA Toolkit 11.5 |
| 1.13.0 | NVIDIA HPC SDK 21.7 |
| 1.12.1 | CUDA Toolkit 11.4 |
| 1.12.0 | NVIDIA HPC SDK 21.3 |
| 1.11.0 | CUDA Toolkit 11.3 |
| 1.10.0 | NVIDIA HPC SDK 20.9 & CUDA Toolkit 11.2 |
| 1.9.10-1 | NVIDIA HPC SDK 20.7 & CUDA Toolkit 11.1 |
| 1.9.10 | NVIDIA HPC SDK 20.5 |
| 1.9.9 | CUDA Toolkit 11.0 |
| 1.9.8-1 | NVIDIA HPC SDK 20.3 |
| 1.9.8 | CUDA Toolkit 11.0 Early Access |
| 1.9.7-1 | CUDA Toolkit 10.2 for Tegra |
| 1.9.7 | CUDA Toolkit 10.2 |
| 1.9.6-1 | NVIDIA HPC SDK 20.3 |
| 1.9.6 | CUDA Toolkit 10.1 Update 2 |
| 1.9.5 | CUDA Toolkit 10.1 Update 1 |
| 1.9.4 | CUDA Toolkit 10.1 |
| 1.9.3 | CUDA Toolkit 10.0 |
| 1.9.2 | CUDA Toolkit 9.2 |
| 1.9.1-2 | CUDA Toolkit 9.1 |
| 1.9.0-5 | CUDA Toolkit 9.0 |
| 1.8.3 | CUDA Toolkit 8.0 |
| 1.8.2 | CUDA Toolkit 7.5 |
| 1.8.1 | CUDA Toolkit 7.0 |
| 1.8.0 | |
| 1.7.2 | CUDA Toolkit 6.5 |
| 1.7.1 | CUDA Toolkit 6.0 |
| 1.7.0 | CUDA Toolkit 5.5 |
| 1.6.0 | |
| 1.5.3 | CUDA Toolkit 5.0 |
| 1.5.2 | CUDA Toolkit 4.2 |
| 1.5.1 | CUDA Toolkit 4.1 |
| 1.5.0 | |
| 1.4.0 | CUDA Toolkit 4.0 |
| 1.3.0 | |
| 1.2.1 | |
| 1.2.0 | |
| 1.1.1 | |
| 1.1.0 | |
| 1.0.0 |
Development Process
Thrust uses the CMake build system to build unit tests, examples, and header tests. To build Thrust as a developer, the following recipe should be followed:
# Clone Thrust and CUB repos recursively:
git clone --recursive https://github.com/NVIDIA/thrust.git
cd thrust
# Create build directory:
mkdir build
cd build
# Configure -- use one of the following:
cmake .. # Command line interface.
ccmake .. # ncurses GUI (Linux only)
cmake-gui # Graphical UI, set source/build directories in the app
# Build:
cmake --build . -j <num jobs> # invokes make (or ninja, etc)
# Run tests and examples:
ctest
By default, a serial CPP host system, CUDA accelerated device system, and C++14 standard are used. This can be changed in CMake. More information on configuring your Thrust build and creating a pull request can be found in CONTRIBUTING.md.
3 May 30, 2022
296 Dec 11, 2022
4 Mar 30, 2021
7.6k Dec 31, 2022
1.2k Jan 5, 2023
491 Dec 30, 2022
12 May 6, 2022
17 Nov 10, 2022
709 Dec 30, 2022
32 Jul 17, 2022
1.4k Dec 27, 2022
1.7k Jan 3, 2023
2 May 16, 2020
774 Dec 29, 2022
1 Jan 21, 2022
3 Dec 28, 2022
360 Dec 27, 2022
10 Sep 7, 2022