1. Home
  2. GPU offloading

Tag: GPU offloading

AI
bg
Running a 13B Model on a 12GB GPU: How Offloading Works

Running a 13B Model on a 12GB GPU: How Offloading Works

admin Nov 11, 2026 0 0

A 13B-parameter model in common quantized formats does not fit comfortably in 12...