[5.45 5.425 6.1 5.9 5.55 6.225 5.975 6.65 6.625 6.525 6.775 5.8 6.225 5.75 5.225 6.3 6.55 5.7 5.85 6.55 5.775 5.825 6.175 6.1 5.8 6.425 6.05 6.025 6.175 6.55 6.175 6. ...
This is a fork of llama.cpp with a custom ggml backend that offloads matrix multiplication to the AMD XDNA2 NPU found in Ryzen AI MAX processors (e.g. Ryzen AI MAX 385). The NPU backend accelerates ...