Quad R9700 AI Pro with vLLM-Radiance easily reaching 17,6k PP

Excerpt

https://preview.redd.it/74bmvel9b5nh1.png?width=1602&format=png&auto=webp&s=0d0c1adaa016a486ffd97c4c466e980dc611b139 I've only recently started looking deeper into vLLM after running llama.cpp for a good while. Initially vLLM (official repo) was terribly slow on my four R9700s (tried that one with two as well), however after trying radiance everything changed. Prefill 17636 - TG at that time was 36,6 That prefill spike was two agent profiles working on different tasks simultaneously (one is writ