Type a name, or just describe what you need. Results blend keyword and meaning-based search. 19 matches, each with an EU availability status.
API · Inference.net
OpenAI-compatible inference API and gateway for open-weight and closed models, with provider failover and pass-through pricing.
Hardware · OpenAI
Custom AI inference chip announced by OpenAI and Broadcom, built to serve ChatGPT-style workloads faster and cheaper.
Library · DeepSeek
Open-source inference framework from DeepSeek for serving DeepSeek models on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs.
Research · DeepSeek
DeepSeek research component for multi-token output, intended to speed up LLM text generation.
App · LM Studio
Desktop app for downloading and running local LLMs, now with Bionic, an agent for work and code.
API · Not Diamond
Intelligent model router API that picks the model and reasoning effort per step for coding agents to cut inference cost.
Library
Open-source streaming MoE inference framework for running large sparse models on laptops, phones and single-GPU PCs.
App
Decentralized inference network where Apple Silicon Mac owners contribute compute and developers call an OpenAI-compatible API.
API · OpenAI
OpenAI high-speed inference tier that serves model output far faster than standard, reportedly around 14x.
Windows-wheel fork of SageAttention, a quantized attention kernel library that speeds up diffusion and video model inference.
Library · NVIDIA
NVIDIA open-source model router that selects a suitable LLM for each task to reduce cost.
App · Ollama
Runs open AI models locally on macOS, Windows and Linux, with an optional paid cloud service for larger models.
Research · MiniMax
MiniMax's open-source sparse top-k and dense attention GPU kernels for NVIDIA SM100 (Blackwell), with a technical report.
Research
Technique of sending each AI task to a different model, e.g. a frontier model for planning and a cheaper one for execution.
Hardware · Groq
Inference provider built on its custom LPU chips, offering fast LLM inference via cloud API (GroqCloud) and dedicated capacity.
Hardware · Cerebras
Wafer-scale AI chips (CS-series) and a cloud inference API serving open models at high token speeds.
Model
8-step distillation LoRA for MOSS-Image-SFT that runs without CFG, for ComfyUI.
Hardware · Xiaomi
Prototype compact desktop AI computer from Xiaomi with 80GB unified memory for running large models locally.
App · Unsloth AI
Open-source desktop and web app for running, fine-tuning and serving open models locally, with agent and search tools.
