BatchIn | AI Inference Cloud

Feature	BatchIn	SiliconFlow
Audit traces	Built-in Ed25519 audit records with browser verification.	No publicly documented equivalent verification layer found as of 2026-04-11.
Batch priority	High / Low / Fill tiers with visible operator tradeoffs.	Standard batch only.
Runtime routing	Expose route control, fallback behavior, and cost shaping in product surfaces instead of hiding them behind support tickets.	More hosted-platform abstraction with fewer operator-visible routing controls.
Payments	Stripe, USDC, and agent-payment roadmap.	Regional payment rails only.
Dedicated Capacity control	Dedicated Capacity with runtime controls and private deployment boundaries.	Reserved capacity without the same operator-visible control model.

POST/v1/usersPublic

Create User

Create a user account (typically called by BFF).

Request Example

{
  "email": "dev@example.com",
  "name": "BatchIn Team",
  "password": "secure_password_123"
}

Response Example

{
  "id": "f6e2c67b-90cf-4f4e-b1e5-31d45f3b1b0a",
  "email": "dev@example.com",
  "name": "BatchIn Team",
  "credit_balance_cents": 0
}

Code Samples

import os
import requests

headers = {}
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/users",
    headers=headers,
    json={
  "email": "dev@example.com",
  "name": "BatchIn Team",
  "password": "secure_password_123"
}
)

print(response.json())

Parameters

Name	Type	Required	Description
email	string(email)	Yes	User email
name	string	Yes	Display name
password	string	Yes	Login password

Error Codes

Code	HTTP	Message	Resolution
conflict	409	Email already exists	Use login flow or a different email.

Open Try it

POST/v1/users/loginPublic

User Login

Request Example

{
  "email": "dev@example.com",
  "password": "secure_password_123"
}

Response Example

{
  "id": "f6e2c67b-90cf-4f4e-b1e5-31d45f3b1b0a",
  "email": "dev@example.com",
  "name": "BatchIn Team",
  "credit_balance_cents": 10000
}

Code Samples

import os
import requests

headers = {}
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/users/login",
    headers=headers,
    json={
  "email": "dev@example.com",
  "password": "secure_password_123"
}
)

print(response.json())

Parameters

Name	Type	Required	Description
email	string(email)	Yes	Login email
password	string	Yes	Login password

Error Codes

Code	HTTP	Message	Resolution
invalid_credentials	401	Invalid email or password	Verify credentials and retry.

Open Try it

GET/v1/users/meBearer

Current User Profile

Get current user profile for authenticated API key.

Request Example

{}

Response Example

{
  "id": "f6e2c67b-90cf-4f4e-b1e5-31d45f3b1b0a",
  "email": "dev@example.com",
  "name": "BatchIn Team",
  "credit_balance_cents": 10000
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/users/me",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/users/by-email?email={email}Public

Get User by Email

Lookup user by email (pre-login check).

Request Example

{}

Response Example

{
  "id": "f6e2c67b-90cf-4f4e-b1e5-31d45f3b1b0a",
  "email": "dev@example.com",
  "name": "BatchIn Team",
  "credit_balance_cents": 10000
}

Code Samples

import os
import requests

headers = {}
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/users/by-email?email={email}",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
email	query:string(email)	Yes	Target email

Error Codes

Code	HTTP	Message	Resolution
not_found	404	User not found	Complete signup first.

Open Try it

POST/v1/keysBearer

Create API Key

Create a new API key with optional rate limit and monthly budget.

Request Example

{
  "name": "Production Key",
  "rate_limit_rpm": 120,
  "monthly_budget_cents": 500000
}

Response Example

{
  "id": "f40cf8b0-c367-4764-92e3-cbd358fa3d76",
  "key": "batchin_api_xxx",
  "key_prefix": "batchin_api",
  "name": "Production Key",
  "rate_limit_rpm": 120,
  "monthly_budget_cents": 500000,
  "created_at": "2026-04-08T18:00:00Z"
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/keys",
    headers=headers,
    json={
  "name": "Production Key",
  "rate_limit_rpm": 120,
  "monthly_budget_cents": 500000
}
)

print(response.json())

Parameters

Name	Type	Required	Description
name	string	No	Key name
rate_limit_rpm	number	No	Requests per minute limit
monthly_budget_cents	number	No	Monthly budget in cents

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/keysBearer

List API Keys

List all API keys for current user.

Request Example

{}

Response Example

[
  {
    "id": "f40cf8b0-c367-4764-92e3-cbd358fa3d76",
    "key_prefix": "batchin_api",
    "name": "Production Key",
    "rate_limit_rpm": 120,
    "is_active": true,
    "created_at": "2026-04-08T18:00:00Z"
  }
]

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/keys",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

DELETE/v1/keys/{id}Bearer

Delete API Key

Delete one API key by id.

Request Example

{}

Response Example

204 No Content

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "DELETE",
    "https://batchin-api.onrender.com/v1/keys/{id}",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
id	path:uuid	Yes	API key id

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.
not_found	404	API key not found	Verify key id and retry.

Open Try it

POST/v1/chat/completionsBearer

Chat Completions

Text and multi-turn chat completion with SSE streaming support.

Request Example

{
  "model": "qwen3-32b",
  "messages": [{"role":"user","content":"Explain attention in 3 bullets"}],
  "temperature": 0.7,
  "stream": false
}

Response Example

{
  "id": "chatcmpl_xxx",
  "object": "chat.completion",
  "model": "qwen3-32b",
  "choices": [{"index":0,"message":{"role":"assistant","content":"..."}}],
  "usage": {"prompt_tokens": 22, "completion_tokens": 90, "total_tokens": 112}
}

Response Headers

Header	Description
traceparent	W3C trace context for linking the request into external tracing systems.
X-BatchIn-Run-Id	BatchIn run id for this execution.
X-BatchIn-Route-Id	Resolved route id.
X-BatchIn-Provider	Resolved upstream provider.
X-BatchIn-Environment	Resolved runtime environment.
X-BatchIn-Prompt-Version	Prompt version bound to this run.
X-VaaS-Record-Id	Audit evidence record id.
X-VaaS-Signature	Audit evidence signature.
X-VaaS-PublicKey	Audit verification public key.

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/chat/completions",
    headers=headers,
    json={
  "model": "qwen3-32b",
  "messages": [{"role":"user","content":"Explain attention in 3 bullets"}],
  "temperature": 0.7,
  "stream": false
}
)

print(response.json())

Parameters

Name	Type	Required	Description
model	string	Yes	Model ID
messages	array	Yes	Chat message array
temperature	number	No	Sampling temperature
max_tokens	number	No	Max output tokens
stream	boolean	No	Enable streaming

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.
payment_required	402	Insufficient balance or budget exceeded	Top up balance or increase monthly budget.

Open Try it

POST/v1/responsesBearer

Responses API

Minimal Responses API compatibility layer that returns a response object plus runtime receipt headers.

Request Example

{
  "model": "qwen3-32b",
  "input": "Explain batch inference in 3 bullets",
  "max_output_tokens": 256
}

Response Example

{
  "id": "resp_chatcmpl_xxx",
  "object": "response",
  "model": "qwen3-32b",
  "output": [
    {
      "type": "message",
      "role": "assistant",
      "content": [{"type":"output_text","text":"..."}]
    }
  ],
  "usage": {"input_tokens": 12, "output_tokens": 10, "total_tokens": 22}
}

Response Headers

Header	Description
traceparent	W3C trace context for linking the request into external tracing systems.
X-BatchIn-Run-Id	BatchIn run id for this execution.
X-BatchIn-Route-Id	Resolved route id.
X-BatchIn-Provider	Resolved upstream provider.
X-BatchIn-Environment	Resolved runtime environment.
X-BatchIn-Prompt-Version	Prompt version bound to this run.
X-VaaS-Record-Id	Audit evidence record id.
X-VaaS-Signature	Audit evidence signature.
X-VaaS-PublicKey	Audit verification public key.

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/responses",
    headers=headers,
    json={
  "model": "qwen3-32b",
  "input": "Explain batch inference in 3 bullets",
  "max_output_tokens": 256
}
)

print(response.json())

Parameters

Name	Type	Required	Description
model	string	Yes	Model ID
input	string\|array	Yes	Input text or message array
max_output_tokens	number	No	Max output tokens
stream	boolean	No	Enable streaming (not implemented yet)

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.
not_implemented	501	Streaming Responses is not implemented yet	Use non-streaming /v1/responses or /v1/chat/completions for now.

Open Try it

POST/v1/completionsBearer

Text Completions / FIM

OpenAI-compatible text completions with prefix/suffix FIM-style passthrough.

Request Example

{
  "model": "qwen3-32b",
  "prompt": "Complete this sentence: Batch processing helps",
  "suffix": "for large workloads.",
  "max_tokens": 128
}

Response Example

{
  "id": "cmpl_xxx",
  "object": "text_completion",
  "choices": [{"index":0,"text":"reduce manual toil at scale.","finish_reason":"stop"}],
  "usage": {"prompt_tokens": 24, "completion_tokens": 12, "total_tokens": 36}
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/completions",
    headers=headers,
    json={
  "model": "qwen3-32b",
  "prompt": "Complete this sentence: Batch processing helps",
  "suffix": "for large workloads.",
  "max_tokens": 128
}
)

print(response.json())

Parameters

Name	Type	Required	Description
model	string	Yes	Completion model id
prompt	string\|array	Yes	Prompt or prefix content
suffix	string	No	FIM suffix
max_tokens	number	No	Max completion tokens

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

POST/v1/embeddingsBearer

Embeddings

Convert text into embeddings.

Request Example

{
  "model": "bge-m3",
  "input": ["batch inference", "retrieval augmented generation"]
}

Response Example

{
  "object": "list",
  "data": [
    {"index":0,"embedding":[0.012,-0.043,...]},
    {"index":1,"embedding":[0.021,-0.011,...]}
  ]
}

Response Headers

Header	Description
traceparent	W3C trace context.
X-BatchIn-Run-Id	Run id for this embedding request.
X-BatchIn-Prompt-Version	Prompt version bound to this run.
X-VaaS-Record-Id	Audit evidence record id.

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/embeddings",
    headers=headers,
    json={
  "model": "bge-m3",
  "input": ["batch inference", "retrieval augmented generation"]
}
)

print(response.json())

Parameters

Name	Type	Required	Description
model	string	Yes	Embedding model id
input	string\|array	Yes	Text input to embed

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

POST/v1/audio/speechBearer

Audio Speech

Convert text into synthesized speech with CosyVoice / TTS-compatible models.

Request Example

{
  "model": "cosyvoice",
  "input": "Welcome to BatchIn",
  "voice": "alloy",
  "response_format": "mp3"
}

Response Example

Binary audio payload (audio/mpeg)

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/audio/speech",
    headers=headers,
    json={
  "model": "cosyvoice",
  "input": "Welcome to BatchIn",
  "voice": "alloy",
  "response_format": "mp3"
}
)

print(response.content)

Parameters

Name	Type	Required	Description
model	string	Yes	Speech model id
input	string	Yes	Text to synthesize
voice	string	No	Voice preset
response_format	string	No	Audio response format

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

POST/v1/video/generateBearer

Video Generate

Start video generation jobs with Wan 2.2-style models.

Request Example

{
  "model": "wan-2.2",
  "prompt": "Create a product teaser for an AI cloud launch",
  "duration_seconds": 6
}

Response Example

{
  "id": "video_xxx",
  "object": "video.generation",
  "status": "queued",
  "duration_seconds": 6,
  "output_url": "https://batchin-api.onrender.com/v1/files/file_video_xxx/content"
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/video/generate",
    headers=headers,
    json={
  "model": "wan-2.2",
  "prompt": "Create a product teaser for an AI cloud launch",
  "duration_seconds": 6
}
)

print(response.json())

Parameters

Name	Type	Required	Description
model	string	Yes	Video model id
prompt	string	Yes	Video prompt
duration_seconds	number	No	Video duration in seconds
aspect_ratio	string	No	Aspect ratio

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

POST/v1/images/generationsBearer

Image Generation

Generate images from text prompts.

Request Example

{
  "model": "flux-schnell",
  "prompt": "A futuristic city at sunrise",
  "size": "1024x1024"
}

Response Example

{
  "created": 1775671200,
  "data": [{"url":"https://batchin.tech/images/generated/abc.png"}]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/images/generations",
    headers=headers,
    json={
  "model": "flux-schnell",
  "prompt": "A futuristic city at sunrise",
  "size": "1024x1024"
}
)

print(response.json())

Parameters

Name	Type	Required	Description
model	string	Yes	Image model id
prompt	string	Yes	Image prompt
size	string	No	Output size

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/modelsPublic

List Models

Returns model status, pricing, context length, and license metadata.

Request Example

{}

Response Example

{
  "object": "list",
  "data": [
    {
      "id":"qwen3-32b",
      "status":"always_on",
      "context_length":131072,
      "pricing":{"std_input":0.02,"std_output":0.08}
    }
  ]
}

Code Samples

import os
import requests

headers = {}
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/models",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
service_unavailable	503	Model service unavailable	Check status page and retry later.

Open Try it

POST/v1/batchesBearer

Create Batch

Submit batch jobs with mixed-model tasks and priorities.

Request Example

{
  "priority": "fill",
  "webhook_url": "https://your-domain.com/webhooks/batchin",
  "tasks": [
    {"custom_id":"task-1","model":"qwen3-32b","request_body":{"messages":[{"role":"user","content":"translate this"}]}},
    {"custom_id":"task-2","model":"deepseek-r1","request_body":{"messages":[{"role":"user","content":"summarize this"}]}}
  ]
}

Response Example

{
  "id":"0b0db2a6-0baf-4ec4-a5e7-bce60da57db6",
  "status":"pending",
  "priority":"fill",
  "total_tasks":2,
  "completed_tasks":0,
  "failed_tasks":0
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/batches",
    headers=headers,
    json={
  "priority": "fill",
  "webhook_url": "https://your-domain.com/webhooks/batchin",
  "tasks": [
    {"custom_id":"task-1","model":"qwen3-32b","request_body":{"messages":[{"role":"user","content":"translate this"}]}},
    {"custom_id":"task-2","model":"deepseek-r1","request_body":{"messages":[{"role":"user","content":"summarize this"}]}}
  ]
}
)

print(response.json())

Parameters

Name	Type	Required	Description
tasks	array	Yes	Task array (each task can set its own model)
priority	string(high\|low\|fill)	No	Scheduling priority
webhook_url	string(url)	No	Webhook callback URL

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.
payload_too_large	413	Batch JSON payload exceeds 2MB	Split into smaller batches.

Open Try it

GET/v1/batchesBearer

List Batches

List batch jobs for current user.

Request Example

{}

Response Example

[
  {
    "id":"0b0db2a6-0baf-4ec4-a5e7-bce60da57db6",
    "status":"completed",
    "priority":"fill",
    "total_tasks":2,
    "completed_tasks":2,
    "failed_tasks":0
  }
]

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/batches",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/batches/{id}Bearer

Get Batch Detail

Get batch detail including task results.

Request Example

{}

Response Example

{
  "id":"0b0db2a6-0baf-4ec4-a5e7-bce60da57db6",
  "status":"completed",
  "tasks":[{"custom_id":"task-1","status":"completed"}]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/batches/{id}",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
id	path:uuid	Yes	Batch id

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.
not_found	404	Batch not found	Verify batch id.

Open Try it

POST/v1/batches/{id}/cancelBearer

Cancel Batch

Cancel a pending or running batch job.

Request Example

{}

Response Example

{
  "id":"0b0db2a6-0baf-4ec4-a5e7-bce60da57db6",
  "status":"cancelled"
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/batches/{id}/cancel",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
id	path:uuid	Yes	Batch id

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

POST/v1/topup/stripe/checkoutBearer

Create Stripe Checkout

Create Stripe checkout session for credit top-up.

Request Example

{
  "amount_cents": 5000
}

Response Example

{
  "checkout_url":"https://buy.stripe.com/9B65kD4US2fLeEF4zweME00",
  "session_id":"cs_test_xxx"
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/topup/stripe/checkout",
    headers=headers,
    json={
  "amount_cents": 5000
}
)

print(response.json())

Parameters

Name	Type	Required	Description
amount_cents	number	Yes	Top-up amount in cents

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/topup/historyBearer

Top-up History

Get top-up transaction history.

Request Example

{}

Response Example

[
  {
    "id":"1544d6df-8fca-46f3-9091-95f81dc37efa",
    "amount_cents":5000,
    "source":"stripe",
    "reference_id":"cs_test_xxx"
  }
]

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/topup/history",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/topup/usdc/chainsBearer

USDC Chain Info

Get supported USDC chains and deposit addresses.

Request Example

{}

Response Example

{
  "chains":[
    {"chain":"ethereum","deposit_address":"0x...","required_confirmations":12},
    {"chain":"polygon","deposit_address":"0x...","required_confirmations":12}
  ]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/topup/usdc/chains",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/usage/logs?limit=50&offset=0Bearer

Usage Logs

List request-level usage logs.

Request Example

{}

Response Example

[
  {
    "id":"e73f9476-00ea-491f-ba6f-899602247a15",
    "model":"qwen3-32b",
    "input_tokens":120,
    "output_tokens":88,
    "cost_cents":2
  }
]

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/usage/logs?limit=50&offset=0",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
limit	query:number	No	Page size (1-500)
offset	query:number	No	Offset

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/usage/summaryBearer

Usage Summary

Get total requests, tokens, and cost summary.

Request Example

{}

Response Example

{
  "total_requests": 1304,
  "total_input_tokens": 2341122,
  "total_output_tokens": 1111400,
  "total_cost_cents": 18640
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/usage/summary",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.
payment_required	402	API key monthly budget exceeded	Increase key budget or rotate key.

Open Try it

GET/v1/usage/by-modelBearer

Usage by Model

Aggregate usage by model dimension.

Request Example

{}

Response Example

[
  {
    "model":"qwen3-32b",
    "total_requests": 880,
    "total_input_tokens": 1620012,
    "total_output_tokens": 801202,
    "total_cost_cents": 9900
  }
]

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/usage/by-model",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

POST/v1/vaasBearer

Create Audit Record

Create verifiable audit record and signature.

Request Example

{
  "input_text": "What is a zero-knowledge proof?",
  "output_text": "A cryptographic method...",
  "model_id": "qwen3-32b",
  "gpu_id": "gpu-42"
}

Response Example

{
  "audit_id":"ee3cc19e-710d-4a2d-bf01-0edca0c5fdf4",
  "input_hash":"9a5f...",
  "output_hash":"2f1b...",
  "carbon_grams_co2e":0.0126,
  "energy_wh":0.2107,
  "energy_source":"Renewable grid mix",
  "carbon_offset_vs_us_cloud":0.0717,
  "signature":"bfc4..."
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/vaas",
    headers=headers,
    json={
  "input_text": "What is a zero-knowledge proof?",
  "output_text": "A cryptographic method...",
  "model_id": "qwen3-32b",
  "gpu_id": "gpu-42"
}
)

print(response.json())

Parameters

Name	Type	Required	Description
input_text	string	Yes	Input text
output_text	string	Yes	Output text
model_id	string	Yes	Model id
gpu_id	string	No	GPU identifier

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/vaas/{id}Public

Get Audit Record

Fetch audit details by audit_id.

Request Example

{}

Response Example

{
  "audit_id":"ee3cc19e-710d-4a2d-bf01-0edca0c5fdf4",
  "input_hash":"9a5f...",
  "output_hash":"2f1b...",
  "carbon_grams_co2e":0.0126,
  "energy_wh":0.2107,
  "energy_source":"Renewable grid mix",
  "carbon_offset_vs_us_cloud":0.0717,
  "signature":"bfc4..."
}

Code Samples

import os
import requests

headers = {}
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/vaas/{id}",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
id	path:uuid	Yes	Audit id

Error Codes

Code	HTTP	Message	Resolution
not_found	404	Audit record not found	Verify audit_id.

Open Try it

GET/v1/vaas/{id}/verifyPublic

Verify Audit Signature

Verify audit signature validity.

Request Example

{}

Response Example

{
  "audit_id":"ee3cc19e-710d-4a2d-bf01-0edca0c5fdf4",
  "valid": true
}

Code Samples

import os
import requests

headers = {}
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/vaas/{id}/verify",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
id	path:uuid	Yes	Audit id

Error Codes

Code	HTTP	Message	Resolution

Open Try it

GET/v1/vaas/{id}/evidencePublic

Export Evidence Pack

Return the audit evidence pack used for browser verification and export workflows.

Request Example

{}

Response Example

{
  "record_id":"vaas_xxx",
  "run_id":"run_xxx",
  "trace_id":"0123456789abcdef0123456789abcdef",
  "route_id":"default-route",
  "provider":"api-relay",
  "environment":"development",
  "prompt_version_id":"default",
  "verification_method":"Ed25519Signature2020",
  "public_key":"ed25519:pk_xxx",
  "signature":"ed25519:xxx",
  "payload": {"record_id":"vaas_xxx","input_hash":"sha256:...","output_hash":"sha256:..."}
}

Response Headers

Header	Description
Content-Type	JSON evidence pack that can be saved directly or passed into /verify.

Code Samples

import os
import requests

headers = {}
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/vaas/{id}/evidence",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
id	path:uuid	Yes	Audit id

Error Codes

Code	HTTP	Message	Resolution

Open Try it

GET/v1/vaas/pubkey/currentPublic

Get Current Verify Public Key

Get public key used for browser-side signature verification.

Request Example

{}

Response Example

{
  "verify_key_hex":"1fbd9285..."
}

Code Samples

import os
import requests

headers = {}
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/vaas/pubkey/current",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution

Open Try it

GET/v1/traces?limit=20Bearer

List Runtime Traces

List native runtime traces with route, prompt-version, and audit linkage.

Request Example

{}

Response Example

{
  "items": [
    {
      "trace_id":"0123456789abcdef0123456789abcdef",
      "run_id":"run_xxx",
      "record_id":"vaas_xxx",
      "route_id":"default-route",
      "provider":"api-relay",
      "environment":"development",
      "prompt_version_id":"default",
      "model_id":"qwen3-32b"
    }
  ]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/traces?limit=20",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
limit	query:number	No	Page size (1-100)

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/traces/{trace_id}Bearer

Get Runtime Trace

Fetch one native runtime trace by trace_id.

Request Example

{}

Response Example

{
  "trace_id":"0123456789abcdef0123456789abcdef",
  "run_id":"run_xxx",
  "record_id":"vaas_xxx",
  "route_id":"default-route",
  "provider":"api-relay",
  "environment":"development",
  "prompt_version_id":"default",
  "model_id":"qwen3-32b"
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/traces/{trace_id}",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
trace_id	path:string	Yes	Trace ID

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.
not_found	404	Trace not found	Verify the trace id and retry.

Open Try it

GET/v1/promptsBearer

Prompt Registry

Return prompt registries with promoted versions, latest observed versions, and version details.

Request Example

{}

Response Example

{
  "status":"ready",
  "docs":"/docs/prompts",
  "items":[
    {
      "registry_id":"support",
      "display_name":"support",
      "source":"auto_backfill",
      "latest_version_id":"support@v2",
      "promoted_version_id":"support@v2",
      "total_runs":4,
      "versions":[
        {
          "version_id":"support@v1",
          "status":"observed",
          "total_runs":2
        },
        {
          "version_id":"support@v2",
          "status":"promoted",
          "total_runs":2
        }
      ]
    }
  ]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/prompts",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/prompt-regressionsBearer

Prompt Regression Results

Return automatic sampled-replay regression runs with sample counts, similarity, and latency summaries.

Request Example

{}

Response Example

{
  "status":"ready",
  "docs":"/docs/experiments",
  "items":[
    {
      "regression_id":"preg_demo",
      "registry_id":"support",
      "baseline_prompt_version_id":"support@v1",
      "candidate_prompt_version_id":"support@v2",
      "status":"passed",
      "judge":"deterministic_replay",
      "sample_count":3,
      "pass_count":3,
      "fail_count":0,
      "avg_similarity":1,
      "baseline_avg_latency_ms":420,
      "candidate_avg_latency_ms":390
    }
  ]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/prompt-regressions",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/experimentsBearer

Experiments Control Plane

Return automatic experiments for candidate prompt versions, including replay state and auto-promotion results.

Request Example

{}

Response Example

{
  "status":"ready",
  "docs":"/docs/experiments",
  "items":[
    {
      "experiment_id":"pexp_demo",
      "registry_id":"support",
      "baseline_prompt_version_id":"support@v1",
      "candidate_prompt_version_id":"support@v2",
      "status":"passed",
      "promotion_status":"promoted",
      "sample_count":3,
      "pass_rate":1
    }
  ]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/experiments",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

POST/v1/otlp/tracesBearer

OTLP Trace Ingest

Accept OTLP/HTTP JSON or protobuf traces and merge spans into the unified trace control plane.

Request Example

{
  "resourceSpans": []
}

Response Example

{}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
headers["Content-Type"] = "application/json"
response = requests.request(
    "POST",
    "https://batchin-api.onrender.com/v1/otlp/traces",
    headers=headers,
    json={
  "resourceSpans": []
}
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/v1/otlp/exportBearer

OTLP Trace Export

Export spans from the unified trace control plane as OTLP protobuf or JSON.

Request Example

{}

Response Example

{
  "resourceSpans":[]
}

Code Samples

import os
import requests

headers = {}
headers["Authorization"] = f"Bearer {os.environ['BATCHIN_API_KEY']}"
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/v1/otlp/export",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution
unauthorized	401	API key is invalid or missing	Verify Authorization: Bearer <API_KEY>.

Open Try it

GET/healthPublic

Health Check

Service health probe endpoint.

Request Example

{}

Response Example

{
  "status":"ok"
}

Code Samples

import os
import requests

headers = {}
response = requests.request(
    "GET",
    "https://batchin-api.onrender.com/health",
    headers=headers,
    
)

print(response.json())

Parameters

Name	Type	Required	Description
No parameters

Error Codes

Code	HTTP	Message	Resolution

Open Try it

BatchIn Developer Documentation

Turn docs into running workloads

BatchIn vs SiliconFlow

Quick Start (3 Languages)

1) Install

2) First Request

3) Streaming

Platform Playbooks

Dedicated Capacity Request Path

Private Cluster Deployment Path

Route Control + Failover Path

Audit Trace Verification Path

Ground Truth Diagnostics

OTLP Observability Path

API Reference

Create User

Request Example

Response Example

Code Samples

Parameters

Error Codes

User Login

Request Example

Response Example

Code Samples

Parameters

Error Codes

Current User Profile

Request Example

Response Example

Code Samples

Parameters

Error Codes

Get User by Email

Request Example

Response Example

Code Samples

Parameters

Error Codes

Create API Key

Request Example

Response Example

Code Samples

Parameters

Error Codes

List API Keys

Request Example

Response Example

Code Samples

Parameters

Error Codes

Delete API Key

Request Example

Response Example

Code Samples

Parameters

Error Codes

Chat Completions

Request Example

Response Example

Response Headers

Code Samples

Parameters

Error Codes

Responses API

Request Example

Response Example

Response Headers

Code Samples

Parameters

Error Codes

Text Completions / FIM

Request Example

Response Example

Code Samples

Parameters

Error Codes

Embeddings

Request Example

Response Example