Home » Tag Archives: Nvidia

Tag Archives: Nvidia

Nvidia compares Blackwell and Hopper GPUs on LLM inferencing

Nvidia GB200 NVL72 cluster

Nvidia has announced results for its forthcoming Blackwell GPU in the latest round of MLPerf industry benchmarks, Inference v4.1. “The Blackwell platform revealed up to 4x more performance than the Hopper architecture on MLPerf’s biggest LLM [large language model] workload, Llama 2 70B, thanks to its use of a second-generation transformer engine and FP4 tensor cores,” according to the company. ...

Nvidia offers blueprints from which to develop generative AI applications

Nvidia blueprints

Nvidia has announced pre-trained, customisable AI workflows for creating customer service avatars, for data-mining pdf documents, and for virtual drug screening. They are the first three ‘NIM Agent Blueprints’, which the company said will be a catalogue of products to jump-start developers creating applications based on AI agents. They include sample applications built with Nvidia’s ‘NeMo’, ‘NIM’ and partner micro-services, ...

Q1 down 2%

IMG_0107-300x200.jpeg

The Q1 semiconductor market fell about  2%  to $151.5 billion, says Omdia. Consumer  fell 10.4% q-o-q, industrial fell 8.5% and auto dropped 5.1% but data processing rose  3.7%, driven by demand for NVIDIA’s chips and other AI-related products. NVIDIA expanded its market share by more than two percentage points and now represents 14.5% of the total semiconductor market revenues overtaking ...

The AI roadmap is taking shape

nvidia-1-300x200.jpg

The Blackwell architecture took pole position at this year’s Nvidia GTC in California. Caroline Hayes looks at its role in Drive Thor in-vehicle computing in some of the latest models on our roads. Drive Thor targets the 2025 production models, in which more automated and assisted driving will be included. It is Nvidia’s latest in-vehicle computing platform and the successor ...

Nvidia enabling AI factories

NVIDIA-Blackwell-Architecture-Image-600-300x200.jpg

Nvidia will bring out  a new family of AI chips every year, says CEO Jensen Huang. The next one, called Rubin, containing networking  ICs, a GPU and a CPU (called Versa) will be out in 2026. ASRock Rack, ASUS, GIGABYTE, Ingrasys, Inventec, Pegatron, QCT, Supermicro, Wistron and Wiwynn will deliver cloud, on-premises, embedded and edge AI systems using Nvidia GPUs ...

MCU-based AI tool detects visual anomalies rather than known features

Edge Impulse anomaly detection

Edge Impulse has introduced AI software for Arm microcontrollers and Nvidia processors intended to spot previously unseen and untrained anomalies in images, for industrial inspection, medical imaging and logistics, for example. It is based on ‘Gaussian mixture models’ – GMMs. “Neural networks are powerful but have a major drawback: handling unseen data, like defects in a product during manufacturing, is ...

Accelerated versions of Llama 3 optimised for Nvidia GPUs

IMG_2924-300x200.webp

In collaboration with Meta, NVIDIA has announced the availability of accelerated versions of Llama 3, optimized for NVIDIA GPUs, across cloud, data center, edge, and PC environments. Developers can access Llama 3 at ai.nvidia.com, where it’s offered as an NVIDIA NIM microservice with a standard API for deployment flexibility. Meta revealed its engineers trained Llama 3 on a computer cluster ...

Blackwell proposes “intriguing times”

Keith-Townsend_The-Futurum-Group-300x200.jpeg

The introduction of the Blackwell platform generated a lot of interest but also some searching questions. Electronics Weekly spoke to Keith Townsend, global technology advisor for the Futurum Group who reflected on Nvidia‘s announcement of its Blackwell platform and its leap in performance. “These are intriguing times,” he said. The announcement of Blackwell makes for interesting conversation around scale. Blackwell ...