Nvidia’s $3,000 ‘Personal AI Supercomputer’ Will Let You Ditch the Data Center

Date:

Share:


Nvidia already sells boatloads of computer chips to every major company building proprietary artificial intelligence models. But now, at a moment when public interest in open source and do-it-yourself AI is soaring, the company announced it will also begin offering a “personal AI supercomputer” later this year, starting at $3,000, that anyone can use in their own home or office.

Nvidia’s new desktop machine, dubbed Digits, will go on sale in May and is about the size of a small book. It contains an Nvidia “superchip” called GB10 Grace Blackwell, optimized to accelerate the computations needed to train and run AI models, and comes equipped with 128 gigabytes of unified memory and up to 4 terabytes of NVMe storage for handling especially large AI programs.

Jensen Huang, founder and CEO of Nvidia, announced the new system, along with several other AI offerings, during a keynote speech today at CES, an annual confab for the computer industry held in Las Vegas. (You can check out all of the biggest announcements on the WIRED CES live blog.)

“Placing an AI supercomputer on the desks of every data scientist, AI researcher, and student empowers them to engage and shape the age of AI,” Huang said in a statement released ahead of his keynote.

Nvidia says the Digits machine, which stands for “deep learning GPU intelligence training system,” will be able to run a single large language model with up to 200 billion parameters, a rough measure of a model’s complexity and size. To do this today, you would need to rent space from a cloud provider like AWS or Microsoft, or build a custom system with a handful of chips designed for running AI. If two Digits machines are connected using a proprietary high-speed interconnect link, Nvidia says they will be able to run the most capable version available of Meta’s open source Llama model, which has 405 billion parameters.

Digits will make it easier for hobbyists and researchers to experiment with models that come close to the basic capabilities of OpenAI’s GPT-4 or Google’s Gemini in their offices or basements. But the best versions of those proprietary models, housed inside giant data centers owned by Microsoft and Google, are most likely larger as well as more powerful than anything Digits could handle.

Nvidia has been one of the largest beneficiaries of the AI boom. Its stock price skyrocketed over the past few years as tech companies clamored to buy vast quantities of the advanced hardware chips it produces, a crucial ingredient for developing cutting-edge AI. The company has proven adept at making hardware and software optimized for AI, and its product road map has become an important signal of where the industry is expected to head next.

When it’s released, Digits will be the most powerful consumer computing hardware Nvidia offers. It already sells a range of chipsets for AI development known as Jetson that start at roughly $250. These can run smaller AI models and either be used like a mini desktop computer or installed on a robot to test different AI programs.



Source link

━ more like this

Your Ring camera footage now comes with a security seal to prevent tampering

Amazon-owned smart home device maker Ring has introduced a new security feature that will give users an easy way to check if the...

UK retail sales: Online jewellers shine, but no festive cheer on the high street – London Business News | Londonlovesbusiness.com

Retail sales volumes were up 0.4% in December month-on-month, following a 0.1% fall in November. The month saw particular growth in online sales, including online jewellers where demand for precious...

The Emperor’s New Clothes: Why organisations stay silent – London Business News | Londonlovesbusiness.com

Matthew Bennett (Willow Ethos founding partner) uses The Emperor’s New Clothes as a metaphor to explore how intelligent and well-meaning people collectively uphold...

Backlash grows over Trump’s dismissal of NATO allies – London Business News | Londonlovesbusiness.com

Donald Trump’s latest remarks on NATO have triggered a sharp backlash across Europe, veteran communities, and diplomatic circles, reopening long-standing wounds over alliance...

AI coding work is shifting fast, and your career path may split

AI coding work is shifting fast, and the upside isn’t landing evenly. A study published in Science suggests AI-assisted coding is now woven into...
spot_img