From GTX-1080Ti to dual GPU with Radeon MI50

Excerpt

The Nvidia GTX-1080Ti has 11GB of VRAM and capable for running 8B to 14B local models. I added an AMD Radeon MI50 16GB VRAM. Now with 27GB VRAM I'm able to run most 30B to 35B local models from VRAM. I got the MI50 GPU for less than $140 and it's firmware flashed to Radeon VII so mini Display port work but power levels are lowered. Benchmarked using Llama.cpp Ubuntu Vulkan pre-built binary build: 851cb34f2 (11055) No driver hassles or conflicts thanks to Kubuntu and Vulkan. https://preview.redd.