Serverless inference API
for open-weight models

OpenAI-compatible API. Configure with one line of code.
Pay per token. ISO 27001 certified.

Serverless INFERENCE API

Open-weight models, in production

The open-weight models teams actually ship with, on one endpoint, billed per million tokens.
Early access now open for select design partners and AI labs.

Serverless Inference
One endpoint for top open-weight models. We run the serving stack, you send requests.

what you get

  • OpenAI-compatible inference endpoints via vLLM, SGLang or Ollama
  • Open-weight models from DeepSeek, Qwen, Kimi, GLM, gpt-oss and Nemotron, plus multilingual embeddings

USE CASES

  • Copilots and chatbot agents (Continue.dev)
  • Self-hosted RAG (AnythingLLM, Onyx, Verba)
  • Meeting and transcription apps (Fireflies, Fathom, Read.ai)
  • LLM gateways and routers (OpenRouter)
  • Batch classification, extraction and summarization

import boto3

from openai import OpenAI

s3  = boto3.client("s3",

endpoint_url="https://eu-central-2.storage.impossiblecloud.com")

llm = OpenAI(base_url="https://api.impossiblecloud.com/v1", api_key=KEY)


doc = s3.get_object(Bucket="legal-eu", Key="msa-2026.txt")["Body"].read().decode()
‍

answer = llm.chat.completions.create(

    model="llama-3.3-70b-instruct",

    messages=[{"role": "user", "content": f"Flag unusual indemnity terms:\n{doc}"}],

)

# Storage and inference in the same EU region — zero egress, one bill

Explore serverless inference for your workload

Tell us the model and the workload. We will come back to you on model fit and availability. Your models run next to your data.

Inquire for early access

Three steps to configure your serverless inference endpoint:

Choose your preferred open-weight model or let us recomend the best options

Tell us what you're building and your expected volume in tokens per second

We'll send you current availability and pricing, billed per million tokens

Tobias Nolte
Compute GTM
Online
Top Cloud Storage Award 2025ISO 27001 Certified

Compute where your data lives

With Impossible Cloud, you can get object storage and GPU compute from one provider, so your models run where your data already lives. No moving data between vendors before you can use it.

"The combination of co-located storage and GPU compute is what made the architecture work. Running batch inference against millions of pathology images at scale requires the data and the compute to be in the same place and it has to be in Europe."
Chief Information Officer @ AI Lab, Medical Imaging
(Early access customer in Germany)

Need bare metal GPU instead?

Serverless inference runs on our hardware. If you need direct control of it, for dedicated bare-metal performance, maximum memory configurations, or a custom cluster layout, our team can configure and deploy to your exact specifications.

GPU server 3D render