Bug report - /usr/local/cuda/lib64 vs /usr/local/cuda-11.8/lib64

[datorresb]

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https:/TimDettmers/bitsandbytes/issues

CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
ERROR: /workspaces/XXX/.venv/bin/python: undefined symbol: cudaRuntimeGetVersion
CUDA SETUP: libcudart.so path is None
CUDA SETUP: Is seems that your cuda installation is not in your path. See #85 for more information.
CUDA SETUP: CUDA version lower than 11 are currently not supported for LLM.int8(). You will be only to use 8-bit optimizers and quantization routines!!
CUDA SETUP: Highest compute capability among GPUs detected: 8.6
CUDA SETUP: Detected CUDA version 00
CUDA SETUP: Loading binary /workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/libbitsandbytes_cpu.so...
/workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('/usr/local/python/current')}
warn(msg)
/workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('https'), PosixPath('/pypa/get-pip/raw/d5cb0afaf23b8520f1bbcfed521017b4a95f5c01/public/get-pip.py')}
warn(msg)
/workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('vs/workbench/api/node/extensionHostProcess')}
warn(msg)
/workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('["/tmp/vscode-ssh-auth-2e71b8bb-d2cb-4cd4-a366-406300137942.sock","/tmp/.X11-unix/X0","/root/.gnupg/S.gpg-agent"]')}
warn(msg)
/workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('//matplotlib_inline.backend_inline'), PosixPath('module')}
warn(msg)
/workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: No libcudart.so found! Install CUDA or the cudatoolkit package (anaconda)!
warn(msg)
/workspaces/XXX/.venv/lib/python3.8/site-packages/bitsandbytes/cextension.py:31: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "

[datorresb]

(xxx-py3.8) root ➜ /workspaces/XXX (feature/notebooks) $ nvidia-smi
Wed Mar 29 13:58:20 2023
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 530.41.03 Driver Version: 531.41 CUDA Version: 12.1 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3080 T... On | 00000000:01:00.0 Off | N/A |
| N/A 43C P8 15W / N/A| 0MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 83 G /Xwayland N/A |
| 0 N/A N/A 6231 G /Xwayland N/A |
| 0 N/A N/A 14268 G /Xwayland N/A |
+---------------------------------------------------------------------------------------+
(xxx-py3.8) root ➜ /workspaces/XXX (feature/notebooks) $ sudo find / -name 'libcudart.so*'
/usr/local/cuda-11.8/targets/x86_64-linux/lib/libcudart.so.11.8.89
/usr/local/cuda-11.8/targets/x86_64-linux/lib/libcudart.so.11.0
/workspaces/XXX/.venv/lib/python3.8/site-packages/nvidia/cuda_runtime/lib/libcudart.so.11.0

[datorresb]

libcudart.so Exist in /usr/local/cuda-11.8 and not in /usr/local/cuda/lib64

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.