Semiconductor Engineering

Inference Moves To The Network

Machine-learning inference started out as a data-center activity, but tremendous effort is being put into inference at the edge. At this point, the “edge” is not a well-defined concept, and future ...
Semiconductor Engineering

How Neural Super Sampling Works: Architecture, Training, And Inference

This blog post is the second in our Neural Super Sampling (NSS) series. The post explores why we introduced NSS and explains its architecture, training, and inference components. In August 2025, we ...
The Next Platform

Where The FPGA Hits The Server Road For Inference Acceleration

There are an increasing number of ways to do machine learning inference in the datacenter, but one of the increasingly popular means of running inference workloads is the combination of traditional ...
The Financial Times

How ‘inference’ is driving competition to Nvidia’s AI chip dominance

Roula Khalaf, Editor of the FT, selects her favourite stories in this weekly newsletter. Nvidia’s challengers are seizing a new opportunity to crack its dominance of artificial intelligence chips ...
Forbes

The Inference Economy: How Sparse Computing And Model Optimization Are Reshaping Enterprise AI Deployment

The AI industry stands at an inflection point. While the previous era pursued larger models—GPT-3's 175 billion parameters to PaLM's 540 billion—focus has shifted toward efficiency and economic ...
VentureBeat

AI inference costs dropped up to 10x on Nvidia's Blackwell — but hardware is only half the equation

Lowering the cost of inference is typically a combination of hardware and software. A new analysis released Thursday by Nvidia details how four leading inference providers are reporting 4x to 10x ...