Skip to content

metal gpu matrix3D addition test - #87

Open
DerrickYLJ wants to merge 39 commits into
mainfrom
MetalGPU
Open

metal gpu matrix3D addition test#87
DerrickYLJ wants to merge 39 commits into
mainfrom
MetalGPU

Conversation

@DerrickYLJ

Copy link
Copy Markdown
Collaborator

In the process of adding metal gpu support, created a folder named metal for element-wise addition of Matrix3D test.

@DamianB-BitFlipper

Copy link
Copy Markdown

Hi! Thanks for the work on this. What is the status of getting this model working on Apple Metal?

I try to make it using: USE_METAL=1 make chat however it errors saying: 'ops/metal/BMM_F16T.cuh' file not found. It looks like the includes ops/metal/ are not a part of this branch. Is this still a work in progress?

@DerrickYLJ

Copy link
Copy Markdown
Collaborator Author

Hi! Thanks for the work on this. What is the status of getting this model working on Apple Metal?

I try to make it using: USE_METAL=1 make chat however it errors saying: 'ops/metal/BMM_F16T.cuh' file not found. It looks like the includes ops/metal/ are not a part of this branch. Is this still a work in progress?

Thanks for your interest! We are still working on Metal GPU support for TinyChatEngine and will be available soon :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants