New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

如果想应用更多的模型，例如InstructBLIP，请问应该怎么修改呢？ #181

Open

Listever opened this issue May 20, 2024 · 1 comment

Listever commented May 20, 2024

No description provided.

Collaborator

KaiLv69 commented May 21, 2024

你好，hf上的模型可以用zero3。如果想用tp，需要把模型里的linear和embedding层改成collie里切过的版本，FYI:

CoLLiE/collie/module.py

Line 45 in 95dd8a2

class ColumnParallelLinearWithoutBias(ColumnParallelLinear):

如果想用pp，可以仿照internlm2改一下

总体上可以参考PR #156

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment