Skip to content

Convert bloomz-7b1-mt to ggml error. #34

Description

I have the following problems when converting bloomz-7b1-mt model:

Some weights of BloomForCausalLM were not initialized from the model checkpoint at D:\projects\code\bloomz-7b1-mt and are newly initialized: ['lm_head.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
...
Traceback (most recent call last):
  File "D:\projects\code\bloomz.cpp\convert-hf-to-ggml.py", line 151, in <module>
    data.tofile(fout)
OSError: 67108864 requested and 0 written

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions