Hands-on GPU inference acceleration experiments across Jetson and cloud GPUs using ONNX Runtime, TensorRT, FP16, and model benchmarks.

LLM Inference Benchmark (vLLM vs SGLang vs Ollama) - Tested on NVIDIA A10G (Ampere) and H100 (Hopper) with Llama 3.1 8B. SGLang wins 3.4x over vLLM at scale.