BasetenNot yet certifiedReleased 10/21/2026

Elephant-1

Elephant-1 is a 9B decision model from Baseten's Base Labs for classification, routing, and scoring. It evaluates structured context against choice, yes/no, and ordered scoring questions and returns answer probabilities and confidence in a single forward pass, without generating free-form text. Applications can use these probabilities to select answers or set confidence thresholds.

View API reference ↓
Input / output priceFrom$0.035 / $0per 1M
24h uptime100.00%

Listed for reference. Inference Bureau dispatches only to certified routes, so requests for this model are refused until one is certified. See certified models.

const res = await fetch("https://api.inferencebureau.com/v1/evaluate", {
  method: "POST",
  headers: {
    Authorization: `Bearer ${process.env.IB_API_KEY}`,
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    "model": "baseten/elephant-1",
    "state": { "review": "Arrived early, works great." },
    "questions": {
      "sentiment": {
        "type": "choice",
        "instructions": "Overall sentiment of the review?",
        "criteria": { "positive": "Favorable", "negative": "Unfavorable" }
      }
    }
  }),
});

const { answers } = await res.json();
console.log(answers.sentiment.choice, answers.sentiment.confidence);

Providers

Dispatch routes requests across these providers and fails over between them without changing the model. Restrict or order providers with team Directives. Prices are gateway list prices before the platform fee.

ProviderContextMax outputLatencyThroughputInputOutputCacheCapabilitiesZDRNo trainingRegionsStatus
Baseten16K0——$0.035$0Read —Write —1 featuresYesYesUSListed

Uptime

24 hours

Request success rate per provider.

Baseten100.00%

Getting started

Create a key on the API Keys page and set it as IB_API_KEY. See the quickstart.

const res = await fetch("https://api.inferencebureau.com/v1/evaluate", {
  method: "POST",
  headers: {
    Authorization: `Bearer ${process.env.IB_API_KEY}`,
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    "model": "baseten/elephant-1",
    "state": { "review": "Arrived early, works great." },
    "questions": {
      "sentiment": {
        "type": "choice",
        "instructions": "Overall sentiment of the review?",
        "criteria": { "positive": "Favorable", "negative": "Unfavorable" }
      }
    }
  }),
});

const { answers } = await res.json();
console.log(answers.sentiment.choice, answers.sentiment.confidence);

Elephant-1 answers POST /v1/evaluate, not chat completions. It is billed on input tokens only.

More models by Baseten

ModelContextInputOutputCacheRelease
baseten/joey-116K$0.010$0Read —Write —10/29/2026
baseten/mammoth-116K$0.100$0Read —Write —10/21/2026