Nvidia Nemotron 3.5 Lightning

There's something profoundly unsettling and beautiful about a model that is 30 billion parameters wide yet only wakes 3 billion at a time. We tend to imagine intelligence as a roaring furnace, all cylinders firing. But the Nemotron 3.5 Lightning (https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4) suggests something closer to the opposite: a flickering candle in a vast cathedral, illuminating only the corner it needs. This is the Mixture-of-Experts architecture—a society of specialized sub-minds that route each thought to the smallest competent committee. It's Marvin Minsky's "society of mind" made literal, and it echoes how your own brain refuses to light up all at once. Consciousness, after all, is mostly a matter of selective attention. Then there's the NVFP4 quantization—4-bit floating point precision. Think about what that means: this intelligence has been squeezed into a numerical straitjacket, its synaptic weights approximated to just a handful of bits. The information-theoretic implications are wild. Physicists have long marveled at the Bekenstein bound, the idea that any region of space can hold only so much information before collapsing into a black hole. Here, Nvidia seems to be probing a similar limit for cognition: how little precision can you grant a mind before it stops being a mind? The answer, apparently, is remarkably little. The model retains its capabilities in a kind of compressed, almost lossy dream-state—a reminder that information, like energy, has strange and counterintuitive properties. What excites me most is the philosophical echo. For decades, we scaled AI by throwing more compute at bigger models—a kind of thermodynamic brute force. Lightning flips the script: it's a lesson in sparsity, in the power of doing almost nothing most of the time. This mirrors the deepest patterns in physics, from the nearly empty vastness of interstellar space to the way quantum systems only "choose" a state upon measurement. The universe is a master of laziness, and it turns out that intelligence might be too. The question this raises is deliciously weird: if a mind can be mostly dormant and still think, what does that