I generated the same 90,000-word novel 37 times across eight local AI models and three graphics cards, to find out which combination actually works on hardware you already own. Both halves of "bigger is better" turned out to be wrong — and the biggest improvement I fo...
Local AI Benchmarks
Reproducible benchmarks of open-weights language models running on consumer hardware. Generation speed, repetition rates, memory footprints, and cost-per-book measured across three machines spanning six years of GPU generations — with the scripts, raw outputs, and failed runs published in full.
What matters more when running AI locally: the model or the machine? I tested two 8B models across three very different GPUs, from an RTX 4070 down to an RTX 2060, and the results surprised me. Faster hardware changed how long I waited. The model itself had a much bigge...
Can a local AI model actually write a novel—and can it do it on hardware normal people already own? I’m benchmarking AI book generation across older GPUs, measuring speed, repetition, memory use, editing burden, and the surprisingly tiny cost of generating a 90,000-...
Can AI really generate a publishable novel in a day? I used BookyAI, a locally hosted Llama model, AutoCrit, and Amazon KDP to create and publish a 126,743-word novel with almost no human rewriting. Here is what worked, what broke, what AI invented, and what I learned a...



