Together AI Llama 3.3 70B Turbo

Together AI Llama 3.3 70B Turbo: $0.88/1M input tokens, 600 tok/s throughput, 310ms latency. Compare on BenchNode.io.

$0.88

per 1M input tokens

$0.88 / 1M output

Free tier available

Specifications

model id: llama-3.3-70b
model family: Llama 3.3
parameters: 70B
context window tokens: 128,000
modality: text
reasoning: No

Performance

Latency (TTFT) 310 ms

lower is better

Uptime SLA 99.9%

Throughput 600 tok/s

310

ms latency

99.9%

uptime

Pricing Detail

input per 1m tokens usd: 0.88
output per 1m tokens usd: 0.88
free tier available: Yes
rate limit tpm: 20,000
rate limit rpm: 60

AI Analysis · gpt-4o-mini

Technical Verdict

The input and output costs of $0.88 / 1M tokens position this API tier at a mid-range price point for its model class, while the throughput of 600 tok/s is relatively fast. The rate limits of 20,000 TPM and 60 RPM suggest suitability for low-volume prototyping rather than high-volume production, and the first-token latency of 310 ms favors batch use over real-time applications.

Ideal Use Case

This tier is appropriate for a batch document processing pipeline with a small team requiring >500k daily requests and a tolerance for moderate latency.