Don't trust frontier models when asking about budget hardware!

Excerpt

Early this year when I was first looking at building up my inference capability you could get the 16GB Tesla P100s for between $60 and $80. Asked claude about it, told me absolutely not worth it. No tensor cores, bad int4/int8, no BF16, not worth it. Needs special power accommodations, Above 4G decoding option in the bios (it made it out like it was some rare option), and a semi-exotic cooling solution. Optimized the shit out of my RX6600XT in llama.cpp as a result. Got pretty far. Decided to sa