Nvidia has announced results for its forthcoming Blackwell GPU in the latest round of MLPerf industry benchmarks, Inference v4.1. “The Blackwell platform revealed up to 4x more performance than the Hopper architecture on MLPerf’s biggest LLM [large language model] workload, Llama 2 70B, thanks to its use of a second-generation transformer engine and FP4 tensor cores,” according to the company. ...
Tag Archives: Nvidia
Nvidia offers blueprints from which to develop generative AI applications
Nvidia has announced pre-trained, customisable AI workflows for creating customer service avatars, for data-mining pdf documents, and for virtual drug screening. They are the first three ‘NIM Agent Blueprints’, which the company said will be a catalogue of products to jump-start developers creating applications based on AI agents. They include sample applications built with Nvidia’s ‘NeMo’, ‘NIM’ and partner micro-services, ...
Q1 down 2%
The Q1 semiconductor market fell about 2% to $151.5 billion, says Omdia. Consumer fell 10.4% q-o-q, industrial fell 8.5% and auto dropped 5.1% but data processing rose 3.7%, driven by demand for NVIDIA’s chips and other AI-related products. NVIDIA expanded its market share by more than two percentage points and now represents 14.5% of the total semiconductor market revenues overtaking ...
The AI roadmap is taking shape
The Blackwell architecture took pole position at this year’s Nvidia GTC in California. Caroline Hayes looks at its role in Drive Thor in-vehicle computing in some of the latest models on our roads. Drive Thor targets the 2025 production models, in which more automated and assisted driving will be included. It is Nvidia’s latest in-vehicle computing platform and the successor ...
AMD to match Nvidia’s one year cadence for AI IC introductions
Earlier today, AMD CEO Lisa Su said AMD would match the one year cadence for new AI processors set yesterday by Jensen Huang, CEO of Nvidia. AMD’s next AI chip – the MI325X – will ship in Q4, said Su. Its successor, the MI350, will ship in 2025 and the successor to the MI350 – the MI400 – will ship ...
Nvidia enabling AI factories
Nvidia will bring out a new family of AI chips every year, says CEO Jensen Huang. The next one, called Rubin, containing networking ICs, a GPU and a CPU (called Versa) will be out in 2026. ASRock Rack, ASUS, GIGABYTE, Ingrasys, Inventec, Pegatron, QCT, Supermicro, Wistron and Wiwynn will deliver cloud, on-premises, embedded and edge AI systems using Nvidia GPUs ...
MCU-based AI tool detects visual anomalies rather than known features
Edge Impulse has introduced AI software for Arm microcontrollers and Nvidia processors intended to spot previously unseen and untrained anomalies in images, for industrial inspection, medical imaging and logistics, for example. It is based on ‘Gaussian mixture models’ – GMMs. “Neural networks are powerful but have a major drawback: handling unseen data, like defects in a product during manufacturing, is ...
Accelerated versions of Llama 3 optimised for Nvidia GPUs
In collaboration with Meta, NVIDIA has announced the availability of accelerated versions of Llama 3, optimized for NVIDIA GPUs, across cloud, data center, edge, and PC environments. Developers can access Llama 3 at ai.nvidia.com, where it’s offered as an NVIDIA NIM microservice with a standard API for deployment flexibility. Meta revealed its engineers trained Llama 3 on a computer cluster ...
Blackwell proposes “intriguing times”
The introduction of the Blackwell platform generated a lot of interest but also some searching questions. Electronics Weekly spoke to Keith Townsend, global technology advisor for the Futurum Group who reflected on Nvidia‘s announcement of its Blackwell platform and its leap in performance. “These are intriguing times,” he said. The announcement of Blackwell makes for interesting conversation around scale. Blackwell ...
What caught your eye this week? (Nvidia, AI startups, Diamond CMOS)
We're talking Nvidia NIMs (Nvidia Inference Microservices) for healthcare, AI, South Korean AI startups, researchers working on Diamond CMOS, and NASA’s Jet Propulsion Laboratory...