Pinned Loading

1. LLM-Inference-Acceleration LLM-Inference-Acceleration Public

   LLM Inference with Deep Learning Accelerator.

   59

2. bert-multi-gpu bert-multi-gpu Public

   Forked from haoyuhu/bert-multi-gpu

   Feel free to fine tune large BERT models with Multi-GPU and FP16 support.

   Python

3. glass-machine glass-machine Public

   GlassMachine: From Bit to Attention

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python