Can these codes be executed on standard GPUs?

[qiuzh20]

It appears that these codes have been designed for execution on Cerebras hardware. Can they be easily adapted for deployment on standard GPUs such as the NVIDIA A100? Thanks a lot!

[TianhuaTao]

The instruction-tuning of CrystalCoder is performed on GPUs using a modified version (to support muP) of Megatron-LM, which can satisfiy your needs, but that codebase and instruct models haven't been released yet. We plan to release them in the very near future.