Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Are registers and VPT-shallow identical? #464

Open
qlOvQlp opened this issue Sep 11, 2024 · 0 comments
Open

Are registers and VPT-shallow identical? #464

qlOvQlp opened this issue Sep 11, 2024 · 0 comments

Comments

@qlOvQlp
Copy link

qlOvQlp commented Sep 11, 2024

I found that the operation of adding registers in the VIT model is identical in implementation to the VPT-shallow approach in Visual Prompt Tuning https://link.springer.com/10.1007/978-3-031-19827-4_41. Are registers and VPT-shallow identical? Can the register operation also be used as a fine-tuning method to improve the performance of tasks downstream of the model?
image
image

@qlOvQlp qlOvQlp changed the title Are registers and VPT-shadow identical? Are registers and VPT-shallow identical? Sep 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant