Google's new chips are a shot at Nvidia — and a big hint at where AI goes next

Google is for the first time splitting its AI chips into two lines, a sign that a new AI battleground is emerging.
marktechpost

NVIDIA Releases AITune: An Open-Source Inference Toolkit That Automatically Finds the Fastest Inference Backend for Any PyTorch Model

Deploying a deep learning model into production has always involved a painful gap between the model a researcher trains and the model that actually runs efficiently at scale. TensorRT exists, ...
Network World

Nvidia targets inference as AI’s next battleground with Groq 3 LPX

The company says its new architecture marks a shift from training-focused infrastructure to systems optimized for continuous, low-latency enterprise AI workloads. 2026 is predicted to be the year that ...
Morningstar

Tenstorrent Unveils TT-QuietBox(TM) 2, the First RISC-V AI Workstation With a Fully Open-Source Stack to Deliver Teraflop-Class Inference

Liquid-Cooled Desktop System Runs Models up to 120B Parameters Locally With a Fully Open-Source Stack, Starting at $9,999 SANTA CLARA, CA / ACCESS Newswire / March 11, 2026 / Tenstorrent, the AI ...
SiliconANGLE

Report: Nvidia is working on a top-secret AI inference chip that could debut next month

Nvidia Corp. is reportedly working on a dedicated inference processor that will be used by OpenAI Group PBC and other artificial intelligence companies to develop faster and more efficient models, ...
The Motley Fool

Prediction: The AI "Inference Era" Will Crown a New Winner by the End of 2026

Nvidia currently dominates the AI chip market, including for inference. AMD should take some share, helped by its deal with OpenAI. However, Broadcom looks like the biggest inference chip winner. The ...
IEEE

Accelerating Simulation-Based Inference with Variational Autoencoders

Abstract: We present a generative modeling approach based on the variational inference framework for likelihood-free simulation-based inference. The method leverages latent variables within ...
Campus Technology

Microsoft Unveils Maia 200 Inference Chip to Cut AI Serving Costs

Microsoft is targeting AI inference costs with custom silicon: Maia 200 is designed specifically to improve the economics of AI token generation as inference spending grows. Inference performance is ...
Semiconductor Engineering

Ultra-low-bit LLM Inference Allows AI-PC CPUs And Discrete Client GPUs To Approach High-end GPU-Level (Intel)

A new technical paper titled “Pushing the Envelope of LLM Inference on AI-PC and Intel GPUs” was published by researcher at Intel. “The advent of ultra-low-bit LLM models (1/1.58/2-bit), which match ...
Redmond Magazine

Microsoft Introduces Maia 200 Inference Chip to Tackle AI Computing Costs

Microsoft is pushing deeper into custom AI silicon for inference. Maia 200 is designed to lower the cost of running AI models in production, as inference increasingly drives AI operating expenses. The ...
SDxCentral

Microsoft reveals Maia 200 & network architecture pushing scale-up inference efficiency

Microsoft has come swinging in the battle of custom hyperscale silicon, debuting its “AI inference powerhouse” Maia 200 accelerator. Built on Taiwan Semiconductor Manufacturing Company's (TSMC) 3nm ...