Type a name, or just describe what you need. Results blend keyword and meaning-based search. 9 matches, each with an EU availability status.
Library
Open-source streaming MoE inference framework for running large sparse models on laptops, phones and single-GPU PCs.
API · Inference.net
OpenAI-compatible inference API and gateway for open-weight and closed models, with provider failover and pass-through pricing.
Library · DeepSeek
Open-source inference framework from DeepSeek for serving DeepSeek models on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs.
Hardware · Groq
Inference provider built on its custom LPU chips, offering fast LLM inference via cloud API (GroqCloud) and dedicated capacity.
Hardware · OpenAI
Custom AI inference chip announced by OpenAI and Broadcom, built to serve ChatGPT-style workloads faster and cheaper.
Windows-wheel fork of SageAttention, a quantized attention kernel library that speeds up diffusion and video model inference.
Hardware · Google
Google's eighth-generation Cloud TPU for post-training and low-latency inference of large MoE models.
Google's custom AI accelerators, offered through Google Cloud for training and inference of machine learning models.
Research
Search framework from Harvard/MIT coupling forward evolutionary candidate search with backward goal decomposition.
