llama-cpp-python with GPU accelleration has issues building with a system that has gcc that is too recent (gcc 12). The command pip uninstall -y llama-cpp-python CMAKE_ARGS="-DLLAMA_CUBLAS=on" ...
$ pip -m venv env # python version of choice - problem here: python3.10rc2 (and ...rc1) $ source env/bin/activate $ pip install streamlit # or: $ pip install numpy; pip install pyarrow # same results ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback