-
Notifications
You must be signed in to change notification settings - Fork 20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
使用fp16如何加载训练之后保存的模型动量呢 #56
Comments
@xealml 你好,请问你基于CPM微调时是怎么加载模型的呢 我看其加载代码中都是有latest_checkpointed_iteration这个文件的 |
直接在启动脚本里修改就好了,这一行 https:/TsinghuaAI/CPM-1-Finetune/blob/main/scripts/language_model/finetune_lm_large_fp32.sh#L4 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
需要如何配置呢?代码需要做什么改动吗
The text was updated successfully, but these errors were encountered: