Pinned post
Fine-tuned Llama-3.1-8B on a 4 GB laptop GPU.
Peak VRAM 3.32 GB. 119.6 tok/s. 100% SM.
The base never fully loads — it streams from RAM one decoder layer at a
time while the card computes the previous one.
Bit-exact vs ordinary training. Paper + code below.
Peak VRAM 3.32 GB. 119.6 tok/s. 100% SM.
The base never fully loads — it streams from RAM one decoder layer at a
time while the card computes the previous one.
Bit-exact vs ordinary training. Paper + code below.