tensor-core

Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

Multiple GEMM operators are constructed with cutlass to support LLM inference.

FastCuda is a handwritten CUDA operator library featuring progressive GEMM and Reduce kernels, cuBLAS benchmarking, and C/C++/Python interfaces for learning, profiling, and performance optimization.

Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.

DeepGEMMPerTensor: clean and efficient FP8 GEMM per tensor kernels without scales

⚡ 3-Million-Gate Blackwell-Class GPU Architecture | 57 SystemVerilog Modules | Yosys Verified | Designed by Adhiraj, India 🇮🇳

Codes for DTC-SpMM (ASPLOS'24)

可验证的 CUDA 学习主线：SGEMM、通用 GPU 算子、性能优化与轻量推理组件

The lab assignments from CS4302 Parallel and Distributed Programming (2022 Fall) with my solutions

A reproducible GPU benchmarking lab that compares FP16 vs FP32 training on MNIST using PyTorch, CuPy, and Nsight profiling tools. This project blends performance engineering with cinematic storytelling—featuring NVTX-tagged training loops, fused CuPy kernels, and a profiler-driven README that narrates the GPU’s inner workings frame by frame.

🎬 Explore GPU training efficiency with FP32 vs FP16 in this modular lab, utilizing Tensor Core acceleration for deep learning insights.

CUDA/C++ LLM 推理运行时：GGUF、W8A16、tokenizer、Paged KV、CUDA Graph 与可复现基准