-
Notifications
You must be signed in to change notification settings - Fork 619
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment! #175
Comments
I encountered the same problem |
Windows is not supported yet. |
This made it work in Windows for me: oobabooga/text-generation-webui#147 (comment) |
@15201308415 I had this problem and fixed it. I wrote some installation instructions over here for my Discord bot if you want to try them. |
I have fixed it by including the .dll and fixed the file path. It now works on windows 10. https:/Keith-Hon/bitsandbytes-windows.git Install the bitsandbytes library by pip install bitsandbytes-windows. Be noted that it may not work directly with transformers library as it references the bitsandbytes package by using 'bitsandbytes' name. <= to avoid this issue, you could directly install from the git repo pip install git+https:/Keith-Hon/bitsandbytes-windows.git |
Uninstall Bitsandbytes and installed the one u provided. Same: CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment! Trying with the 13b model in windows 10 any insides? |
could you try creating a virtual python env first before installing the dependencies. |
This worked for me too. |
Thank you very much, this really helped! |
This worked for me. I was initially trying |
ValueError: 4 bit quantization requires bitsandbytes>=0.39.0 - please upgrade your bitsandbytes version @Keith-Hon: any chance of using the same version numbers as the non-windows package? |
Yes, will merge and update later |
It seems |
For now, how do i solve this error : ValueError: 4 bit quantization requires bitsandbytes>=0.39.0 - please upgrade your bitsandbytes version |
The way I solved it was literally going to the places they specified the
bitsandbytes version and typing 0.35.0 instead, there are 3 files.
Dňa št 6. 7. 2023 o 10:52 Priyamvada ***@***.***> napísala(a):
ValueError: 4 bit quantization requires bitsandbytes>=0.39.0 - please
upgrade your bitsandbytes version
@Keith-Hon <https:/Keith-Hon>: any chance of using the same
version numbers as the non-windows package?
Yes, will merge and update later
For now, how do i solve this error : ValueError: 4 bit quantization
requires bitsandbytes>=0.39.0 - please upgrade your bitsandbytes version
—
Reply to this email directly, view it on GitHub
<#175 (comment)>,
or unsubscribe
<https:/notifications/unsubscribe-auth/ALEZCMFLKCJ2K3PYBBMWD7DXO3UOJANCNFSM6AAAAAAVODJHZE>
.
You are receiving this because you commented.Message ID:
***@***.***>
--
Chris Brousseau (Bru-so)
***@***.***
The terms 'ethical' and 'accurate' have been
used so much by the wrong people that
they've lost all meaning.
|
For anyone wondering, it seems the necessary files to edit are "quantization_config.py" and "bitsandbytes.py" in transformers>utils, and "modeling_utils.py" in transformers. Thanks for the tip, @IMJONEZZ ! |
Great! It works for my project! Thank u |
Right now it not supporting windows |
Many thanks for all the valuable advises. After I installed bitsandbytes-windows by But however when I set use_8bit_adam = True, it shows By the way, I also have the problem as bellow, Thanks for the help in advance. |
After took "from diffusers.utils import is_wandb_available" away, "No module named 'triton'" gone away. But it shows as bellow now, I am doing train_text_to_image in diffusers, using GTX 1080Ti GPU. Is the GPU too old for use_8bit_adam? |
On the same issue, I also try to use 2 GPUs, so I set as below, use_8bit_adam = False When doing "for step, batch in enumerate(train_dataloader)", It showed ~\Anaconda\envs\Diff_Hugg\lib\multiprocessing\reduction.py:60 in dump please help, if someone knows the problem. Thanks! |
i met the same question. |
I compile bitsandbytes from source code and solved this problem:
second: download source code and compile
finally, execute :
you will see these information at the end of the output: `++++++++++++++++++++++++++ OTHER +++++++++++++++++++++++++++ Running a quick check that: WARNING: Please be sure to sanitize sensible info from any such env vars! SUCCESS! my cuda is 11.6. |
I did as you said, now I have another error: n post_init |
Bitsandbytes was not supported windows before, but my method can support windows.(yuhuang) 3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows 4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https:/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl Replace your SD venv directory file(python.exe Folder) here(J:\StableDiffusion\sdwebui\py310) |
yep, i did so |
OR you are Linux distribution (Ubuntu, MacOS, etc.)system ,AND CUDA Version: 11.X. Bitsandbytes can support ubuntu.(yuhuang) 3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows 4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https:/TimDettmers/bitsandbytes/releases/download/0.41.0/bitsandbytes-0.41.0-py3-none-any.whl Replace your SD venv directory file(python.exe Folder) here(J:\StableDiffusion\sdwebui\py310) |
I did everything as you said, but when I launch my console application with AI, it doesn’t give me an answer |
Try this: it's worked for me in Window 10.
|
(venv) F:\eib>pip install https:/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl |
Dear all, Since the current release (last week, 8th of March) we now have official support for Windows 🎉 (which we did not have before) via
We're closing all old Windows issues and are asking everyone to try installing with this new version as outlined above and validate the install with |
C:\ProgramData\Anaconda3\envs\novelai\lib\site-packages\bitsandbytes\cuda_setup\main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {WindowsPath('C'), WindowsPath('/ProgramData/Anaconda3/envs/novelai/lib')}
warn(msg)
C:\ProgramData\Anaconda3\envs\novelai\lib\site-packages\bitsandbytes\cuda_setup\main.py:136: UserWarning: C:\ProgramData\Anaconda3\envs\novelai did not contain libcudart.so as expected! Searching further paths...
warn(msg)
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
C:\ProgramData\Anaconda3\envs\novelai\lib\site-packages\bitsandbytes\cuda_setup\main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {WindowsPath('/usr/local/cuda/lib64')}
warn(msg)
CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
C:\ProgramData\Anaconda3\envs\novelai\lib\site-packages\bitsandbytes\cuda_setup\main.py:136: UserWarning: WARNING: No libcudart.so found! Install CUDA or the cudatoolkit package (anaconda)!
warn(msg)
C:\ProgramData\Anaconda3\envs\novelai\lib\site-packages\bitsandbytes\cuda_setup\main.py:136: UserWarning: WARNING: No GPU detected! Check your CUDA paths. Proceeding to load CPU-only library...
warn(msg)
CUDA SETUP: Loading binary C:\ProgramData\Anaconda3\envs\novelai\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
argument of type 'WindowsPath' is not iterable
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
CUDA SETUP: Loading binary C:\ProgramData\Anaconda3\envs\novelai\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
The text was updated successfully, but these errors were encountered: