New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimizer fixes #1100

Merged

dfalbel merged 3 commits into main from optim-fixes

Sep 11, 2023

Member

dfalbel commented Sep 11, 2023

Adds cosine annealing learnign rate schedulers
Make sure we correctly recover state dicts from learning rate schedulers.
Make sure we correctly reload state dicts from optmiizers


Adds cosine annealing and make sure we correctly recover state dicts …

3d14724

…from learning rate schedulers.

dfalbel mentioned this pull request

luz_callback_auto_resume doesn't resume ctx$epoch mlverse/luz#136

Closed

dfalbel added 2 commits

September 11, 2023 13:29


test

675cf31


use integer step size.

7ce70a5

dfalbel merged commit 1610838 into main

8 of 9 checks passed

dfalbel deleted the optim-fixes branch

September 11, 2023 20:11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment