// PROJECT DATABASE

Projects

10 hands-on CUDA projects · from first kernel to advanced optimization

CATEGORY

DIFFICULTY

10 results

ParallelismBeginner

Vector Addition

The 'Hello World' of GPU programming. Add two arrays element-wise on the GPU, then measure memory bandwidth to understand the roofline model.

vectorcudaMalloccudaMemcpy+2
~20 min
ParallelismBeginner

Hello CUDA

Write your first GPU kernel and understand the CUDA execution model: thread indexing, kernel launch syntax, and GPU/CPU synchronization.

kernelthreadIdxblockIdx+2
~30 min
MemoryBeginner

Matrix Transpose — Three Ways

Implement matrix transpose three times — naive, shared memory, and bank-conflict-free — and benchmark each version. This project exposes why memory access patterns dominate GPU performance.

global-memoryshared-memorybank-conflicts+2
~60 min1 prereq
MemoryIntermediate

GPU Image Processing Pipeline

Build a complete image processing pipeline: grayscale conversion → Gaussian blur → Sobel edge detection. Each stage is a separate CUDA kernel; chain them with CUDA streams and benchmark every step.

convolutionshared-memorycudaStreams+3
~90 min1 prereq
AlgorithmsIntermediate

Parallel Prefix Scan

Implement the fundamental parallel scan primitive — first a work-inefficient Hillis-Steele scan, then a work-efficient Blelloch scan, then scale to multi-block arrays.

scanprefix-sumBlelloch+3
~75 min1 prereq
AlgorithmsIntermediate

GPU Histogram with Privatization

Compute an 8-bit grayscale histogram three ways: global atomics, per-warp privatization, and per-block shared-memory privatization.

atomicsatomicAddshared-memory+2
~60 min1 prereq
AlgorithmsIntermediate

Parallel Reduction — Six Optimizations

Follow the classic NVIDIA reduction progression. Start with a naive implementation and apply six successive optimizations — from divergent warps to warp shuffle intrinsics.

reductionwarp-shuffle__shfl_down_sync+2
~75 min1 prereq
OptimizationAdvanced

Tiled SGEMM — Building a Mini cuBLAS

Implement single-precision general matrix multiply (SGEMM) from scratch. Progress through naive, tiled, and register-file micro-tiled kernels. Benchmark against cuBLAS.

GEMMSGEMMtiling+3
~120 min1 prereq
AlgorithmsAdvanced

N-Body Gravitational Simulation

Simulate gravitational N-body dynamics on the GPU. Build the naive all-pairs force kernel, tile it with shared memory, implement leapfrog time integration, and track energy conservation.

N-bodyshared-memorytiling+3
~120 min1 prereq
AlgorithmsAdvanced

GPU Radix Sort

Build a fully parallel LSD radix sort on the GPU. Implement digit histogram, exclusive scan for scatter addresses, and the scatter kernel.

radix-sortscanscatter+2
~120 min2 prereqs