Reddit r/LocalLLaMASeptember 27, 2026
Imbalanced VRAM usage between two GPUs in llama.cpp. Anyone successfully solve this?
Excerpt
There is always at least 1+GB of VRAM not usable not matter how I set the --tensor-split (-ts) param. I tiny shift toward one side will move the weight significantly to the other side. 😵💫 Adjusting context will increase/decrease usage on both side. --tensor-split 499,501 = GPU1 12.5 GB, GPU2 15.4 GB --tensor-split 501, 499 = GPU1 14.7 GB, GPU2 13.4 GB Tried --spec-draft-device with CUDA0 and CUDA1 separately, no change at all. (same distribution as above) Also tried --mmproj-device , no much di