Nvidia released Nemotron 3.5 Lightning, a small open-source model that companies can download, change and run without paying or asking permission. The company says it runs on a single graphics card in a laptop or desktop and was built for software agents that work on their own in the background. Nvidia also released NeMo Switchyard, which picks the cheapest suitable model for a given task.
What changed
Nvidia's prior Nemotron models were larger and it had not put out an open model since Huang's public backing of the approach.
What it unlocks
Downloading and modifying a capable Nvidia model at no cost, running it on one graphics card in a laptop or desktop.
- runs on a single GPU
What you need to act on it
- a machine with a suitable GPU
- engineering capacity to deploy a self-hosted model
Sources