MA
SemiAnalysis MOTS: AI Chip Shortages, SpaceX, China, Neoclouds, and more!Matthew Berman25 Sept 2026
Discussed alongside Cerebras as an inference provider in the chapter on inference providers.
Inference provider built on its custom LPU chips, offering fast LLM inference via cloud API (GroqCloud) and dedicated capacity.
Updated EU status checked Last shown
Groq at a glance
- What is Groq?
- Groq is a hardware from Groq. Inference provider built on its custom LPU chips, offering fast LLM inference via cloud API (GroqCloud) and dedicated capacity.
- Who makes Groq?
- Groq is made by Groq.
- Does Groq work in the EU?
- Unverified. No explicit evidence found. Last verified 14 Nov 2026.
- How much does Groq cost?
- API pricing. Usage-based API pricing via GroqCloud; check the official site for current rates and any free tier. Licence: Proprietary.
- Where was Groq shown?
- In 1 creator video by Matthew Berman. Most recently by Matthew Berman on 25 Sept 2026, at 36:59 in “SemiAnalysis MOTS: AI Chip Shortages, SpaceX, China, Neoclouds, and more!”.
Sources: the vendor's own pages (linked above) and creator videos at the linked timestamps. EU status is information, not legal advice; see how we check.
About
Groq is a US company that designs the Language Processing Unit (LPU), a chip architecture built for AI inference, and runs it as a cloud inference service (GroqCloud). Its site now describes the company as a "neocloud" for fast inference, offering an integrated platform for infrastructure, inference and control.
According to the company, its newer LPX systems work alongside NVIDIA's next-generation GPUs, and it is building out hundreds of megawatts of capacity. Developers typically access hosted open models through an API with documentation at console.groq.com. Media coverage, such as a SemiAnalysis discussion, mentions Groq alongside Cerebras as an inference provider.
The provided material does not list specific models, prices, rate limits or regional availability, so those should be checked on the official pages.
Key features
- Custom LPU architecture designed for inference
- GroqCloud API for hosted models
- LPX systems that work alongside NVIDIA GPUs
- Integrated platform covering infrastructure, inference and control
- Large-scale data center capacity buildout
1 moment
As seen on YouTube
Watch the moment: the exact second top creators show it. Videos load only when you press play, via youtube-nocookie.com.
Keep exploring
Similar AI tools
Closest neighbours by meaning, not just by category.
IN
Inference.net
API · Inference.net
OpenAI-compatible inference API and gateway for open-weight and closed models, with provider failover and pass-through pricing.
UnverifiedPlatforms & Infra
Release date n/aAPI
OI
OpenAI inference chip
Hardware · OpenAI
Custom AI inference chip announced by OpenAI and Broadcom, built to serve ChatGPT-style workloads faster and cheaper.
UnverifiedHardware & Devices
Release date n/a
DE
DeepInfer
Library · DeepSeek
Open-source inference framework from DeepSeek for serving DeepSeek models on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs.
Available in EUPlatforms & Infra
16 Oct 2026Open source
CE
Cerebras
Hardware · Cerebras
Wafer-scale AI chips (CS-series) and a cloud inference API serving open models at high token speeds.
Available in EUHardware & Devices
Release date n/aAPI
UF
Ultra Fast mode
API · OpenAI
OpenAI high-speed inference tier that serves model output far faster than standard, reportedly around 14x.
UnverifiedPlatforms & Infra
Release date n/aAPI
ED
Edge0
Library
Open-source streaming MoE inference framework for running large sparse models on laptops, phones and single-GPU PCs.
Available in EUPlatforms & Infra
8 Sept 2026Open source