Nvidia’s $3,000 ‘Personal AI Supercomputer’ Will Let You Ditch the Data Center

Date:

Share:


Nvidia already sells boatloads of computer chips to every major company building proprietary artificial intelligence models. But now, at a moment when public interest in open source and do-it-yourself AI is soaring, the company announced it will also begin offering a “personal AI supercomputer” later this year, starting at $3,000, that anyone can use in their own home or office.

Nvidia’s new desktop machine, dubbed Digits, will go on sale in May and is about the size of a small book. It contains an Nvidia “superchip” called GB10 Grace Blackwell, optimized to accelerate the computations needed to train and run AI models, and comes equipped with 128 gigabytes of unified memory and up to 4 terabytes of NVMe storage for handling especially large AI programs.

Jensen Huang, founder and CEO of Nvidia, announced the new system, along with several other AI offerings, during a keynote speech today at CES, an annual confab for the computer industry held in Las Vegas. (You can check out all of the biggest announcements on the WIRED CES live blog.)

“Placing an AI supercomputer on the desks of every data scientist, AI researcher, and student empowers them to engage and shape the age of AI,” Huang said in a statement released ahead of his keynote.

Nvidia says the Digits machine, which stands for “deep learning GPU intelligence training system,” will be able to run a single large language model with up to 200 billion parameters, a rough measure of a model’s complexity and size. To do this today, you would need to rent space from a cloud provider like AWS or Microsoft, or build a custom system with a handful of chips designed for running AI. If two Digits machines are connected using a proprietary high-speed interconnect link, Nvidia says they will be able to run the most capable version available of Meta’s open source Llama model, which has 405 billion parameters.

Digits will make it easier for hobbyists and researchers to experiment with models that come close to the basic capabilities of OpenAI’s GPT-4 or Google’s Gemini in their offices or basements. But the best versions of those proprietary models, housed inside giant data centers owned by Microsoft and Google, are most likely larger as well as more powerful than anything Digits could handle.

Nvidia has been one of the largest beneficiaries of the AI boom. Its stock price skyrocketed over the past few years as tech companies clamored to buy vast quantities of the advanced hardware chips it produces, a crucial ingredient for developing cutting-edge AI. The company has proven adept at making hardware and software optimized for AI, and its product road map has become an important signal of where the industry is expected to head next.

When it’s released, Digits will be the most powerful consumer computing hardware Nvidia offers. It already sells a range of chipsets for AI development known as Jetson that start at roughly $250. These can run smaller AI models and either be used like a mini desktop computer or installed on a robot to test different AI programs.



Source link

━ more like this

A new breed of Android flagships is coming and it should make Samsung nervous

A new wave of Android flagships is on the horizon, and they’re not playing it safe. The biggest shift is that these phones...

Watch the trailer for Science Saru’s Ghost in the Shell anime series

A new trailer has given us our best look yet at the upcoming The Ghost in the Shell anime. While it might not...

Apple is opening Siri to pick AI models, but there’s only only that makes sense to me 

Apple promised us a smarter, more capable Siri at WWDC 2024. The pitch was compelling: a Siri that understands your personal context, digs...

YouTube CEO opens up about AI slop, and it sounds like cozy promises

YouTube is in a slightly tricky position right now. On one hand, it’s encouraging creators to use AI tools to make content faster...

Meta’s next smart glasses sound like a treat for humans stuck with prescription lenses

For the billions of people who rely on corrective glasses every day (including me), smart glasses have always been a slightly awkward conversation....
spot_img