Llama 3.3 70B

Llama 3.3 70B is listed on the current BatchIn Model API surface.

Model detailAvailableDense Transformer

Params

70B

Context

128K

Max Output

16K

License

Proprietary

API Surface

/v1/chat/completions

Access

Available

Why pick it

Availability is synced from the live service catalog.
Pricing appears only when verified by the live service catalog.

Pricing

TierPublicCachedNote

RealtimePricing is synced from the live BatchIn catalog.N/ACurrent published price

BatchContact us for batchN/APublished batch rates appear here when available

Pricing is synced from the live BatchIn catalog.

Quick start

Works with common OpenAI-style integrations. Point your client to the BatchIn base URL and start testing.

Try now Open pricing

Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.batchin.tech/v1",
    api_key="BATCHIN_API_KEY"
)

resp = client.chat.completions.create(
    model="llama-3.3-70b",
    messages=[{"role": "user", "content": "Summarize why this model is a fit for my workload"}]
)

print(resp.choices[0].message.content)

JavaScript

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.batchin.tech/v1",
  apiKey: process.env.BATCHIN_API_KEY,
});

const resp = await client.chat.completions.create({
  model: "llama-3.3-70b",
  messages: [{ role: "user", content: "Summarize why this model is a fit for my workload" }],
});

console.log(resp.choices[0]?.message?.content);

cURL

curl https://api.batchin.tech/v1/chat/completions \
  -H "Authorization: Bearer ***" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.3-70b",
    "messages": [{"role":"user","content":"Summarize why this model is a fit for my workload"}]
  }'

Specs

Architecture

Dense Transformer

Vendor