r/LocalLLaMA
·
7h ago
·
7
·
hardware
inference
tutorial
A practical guide to using datacenter GPUs (Tesla V100) for local LLM inference by adding an SXM2-to-PCIe adapter, achieving 32GB VRAM across two GPUs for ~£200. The article provides technical details on memory bandwidth advantages and hardware compatibility considerations for engineers running models locally on consumer hardware.