Is it? This review is pretty thorough with some realistic benchmarks. Spoiler: it won’t replace an entire data center, but it works for model development and testing. Enjoy!
Is it? This review is pretty thorough with some realistic benchmarks. Spoiler: it won’t replace an entire data center, but it works for model development and testing. Enjoy!
Meh. Should have tested ggml performance instead. Using the Metal build of llama.cpp.
Also 460€ for an additional 16GB of RAM is insane.