Implement single-precision general matrix multiply (SGEMM) from scratch. Progress through naive, tiled, and register-file micro-tiled kernels. Benchmark against cuBLAS.
// PREREQUISITES
// PROJECT PHASES
Naive SGEMM
Each thread computes one output element.
Shared memory tiling
Tile A and B into shared memory.
Register micro-tiling
Each thread computes a TM×TN sub-block.
Benchmark vs cuBLAS
Compare TFLOP/s across matrix sizes.
// SANDBOX
GPU execution// EXPECTED OUTPUT
=== 1024x1024 === Naive: 0.41 TFLOP/s Tiled: 4.2 TFLOP/s
// YOUR PROGRESS
Log in to save progress
// DETAILS
// LEARN THE THEORY
Optimization concepts