Issues

• Loading models is not easy with from_pretrained

  microsoft/TransformerCompression#188 · Filter by author NamburiSrinath opened on Jun 10, 2025

• Error when loading sliced llama3.1-70b-Instruct

  microsoft/TransformerCompression#185 · Filter by author Daisy-a-p opened on Feb 10, 2025

• transformers dependency version upgrade

  microsoft/TransformerCompression#183 · Filter by author xiaoyu-work opened on Jan 4, 2025

• adapt the lm_eval tool

  microsoft/TransformerCompression#182 · Filter by author fmk345 opened on Dec 2, 2024

• Some confusion about the equation.6 in the sliceGPT paper.

  microsoft/TransformerCompression#181 · Filter by author julyanghar opened on Nov 25, 2024
  1

• Speed up test

  microsoft/TransformerCompression#179 · Filter by author digbangbang opened on Oct 30, 2024

• Issues with LLAMA 3-8B-Instruct model

  microsoft/TransformerCompression#177 · Filter by author madhusrivatsav opened on Sep 2, 2024

• NaN weights after rotating and slicing

  microsoft/TransformerCompression#176 · Filter by author sriyachakravarthy opened on Aug 17, 2024
  1

• Quarot: DeepSeek-V2 Support

  microsoft/TransformerCompression#174 · Filter by author RanchiZhao opened on Jul 12, 2024

• How to evaluate the sliced model

  microsoft/TransformerCompression#173 · Filter by author 1250826219 opened on Jul 10, 2024

• How to finetune with multi-gpus under data parallel setting?

  microsoft/TransformerCompression#167 · Filter by author kriskrisliu opened on Jun 8, 2024
  1

• model inference

  microsoft/TransformerCompression#160 · Filter by author chris111110 opened on May 22, 2024

• Command R and R+ support

  microsoft/TransformerCompression#133 · Filter by author Steel-skull opened on Apr 12, 2024
  1

• run_benchmark.py runs error when using --distribute-model

  bug
  microsoft/TransformerCompression#122 · Filter by author zhaoyang-star opened on Mar 29, 2024
  1

• How to export entire model?

  good first issuehelp wanted
  microsoft/TransformerCompression#114 · Filter by author YuanzeSun opened on Mar 6, 2024
  10

• Convert Layernorm to RMSnorm

  microsoft/TransformerCompression#110 · Filter by author lihuang258 opened on Mar 1, 2024
  6

• Mistral Support

  microsoft/TransformerCompression#81 · Filter by author fakerybakery opened on Jan 29, 2024
  6

• loading models is painful and not HF compatible

  microsoft/TransformerCompression#73 · Filter by author jameshensman opened on Jan 23, 2024
  1

  

• c4 dataset download fails

  bug
  microsoft/TransformerCompression#56 · Filter by author nailimixaM opened on Jan 11, 2024
  1

• Common command-line args

  enhancement
  microsoft/TransformerCompression#52 · Filter by author nailimixaM opened on Jan 10, 2024