1

I am trying to set up local, high speed NLP but am failing to install the arm64 version of llama-cpp-python.

Even when I run

CMAKE_ARGS="-DLLAMA_METAL=on -DLLAMA_METAL_EMBED_LIBRARY=on" \
pip install llama-cpp-python --no-binary llama-cpp-python --force-reinstall --no-cache-dir

I still get the same error when I try to import it:

RuntimeError: Failed to load shared library '/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/llama_cpp/lib/libllama.dylib': dlopen(/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/llama_cpp/lib/libllama.dylib, 0x0006): tried: '/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/llama_cpp/lib/libllama.dylib' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64e' or 'arm64')), '/System/Volumes/Preboot/Cryptexes/OS/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/llama_cpp/lib/libllama.dylib' (no such file), '/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/llama_cpp/lib/libllama.dylib' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64e' or 'arm64'))

Help would be greatly appreciated!

Improve this question
1
  • on repo llama-cpp-python I see "MacOS Notes" with info "M Series Mac Error: (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64')" and command CMAKE_ARGS="-DCMAKE_OSX_ARCHITECTURES=arm64 -DCMAKE_APPLE_SILICON_PROCESSOR=arm64 -DGGML_METAL=on" pip install --upgrade --verbose --force-reinstall --no-cache-dir llama-cpp-python Commented Jun 22 at 16:54
Related questions
19
mach-o file, but is an incompatible architecture have 'x86_64', need 'arm64e' M1 MAC
0
rpy2 loading error with MacOS 13.5 and m1 chip
2
Is there any way to get cffi to install both x86_64 and arm64 mach-o files on a Macbook(M1)?
Load 6 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.