1. Home
  2. LLM inference

Tag: LLM inference

AI
bg
Running a 13B Model on a 12GB GPU: How Offloading Works

Running a 13B Model on a 12GB GPU: How Offloading Works

admin Nov 11, 2026 0 0

A 13B-parameter model in common quantized formats does not fit comfortably in 12...