-
-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Vram Memory limit problem #469
Labels
documentation
Improvements or additions to documentation
Comments
In default setting inference takes something around 3.5GB of vram. Sorry, but only solution for you is upgrading gpu with more vram or use colab or something like that. |
Thank you for your help |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I have this problem. how to solve it. Thanks
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 2.00 GiB total capacity; 1.55 GiB already allocated; 0 bytes free; 1.71 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
The text was updated successfully, but these errors were encountered: