llama2-70b Free API on NVIDIA NIM

Free API Verified

Available from NVIDIA NIM

★★★★★★★★★★ 3.5 Benchmark-backed score

meta/llama2-70b — free model from NVIDIA NIM (meta).

Free APIOpenAI compatibleText

Try in Playground Compare Save API Key

API Details

Copy-ready connection details

Use these values in your client or SDK.

Base URL

https://integrate.api.nvidia.com/v1

Model ID

meta/llama2-70b

API format OpenAI Chat Completions

Technical Details

llama2-70b specifications

Provider catalog

Context window 131K

Max output 8K

Status Online

Released Jul 18, 2023

Last updated Aug 6, 2026

Free listing since Jul 18, 2023

Input text

Output text

AI Recommendation

Should you use llama2-70b?

llama2-70b is listed for chat workloads and supports a 131K context window.

Use it when NVIDIA NIM's free tier is enough for evaluation, demos, or light production traffic.

Best for

Chat

Strengths & Weaknesses

Strengths

Long context window
Works with OpenAI-style SDKs
Live API verification available

Watch outs

Free-tier rate limits apply
Vision support is not listed
Tool calling is not confirmed

Benchmark Overview

Benchmark signals for llama2-70b

Measured data

Intelligence General reasoning and instruction following

3/100

Context Maximum listed context window

131K

Availability

llama2-70b availability by provider

Current provider only

We only found this llama2-70b listing on NVIDIA NIM in the current catalog. Use the related models section for nearby alternatives.

Provider	Model listing	Access	Context	API	Limits
NVIDIA NIM	meta/llama2-70b	Free tier	131K	OpenAI-style	Up to 40 RPM

View NVIDIA NIM setup guide →

Compare

llama2-70b alternatives to consider

Open comparison

Model	Provider	Context	Access
01-ai/yi-large	NVIDIA NIM	131K	Free tier
adept/fuyu-8b	NVIDIA NIM	131K	Free tier
ai21labs/jamba-1.5-large-instruct	NVIDIA NIM	131K	Free tier
aisingapore/sea-lion-7b-instruct	NVIDIA NIM	131K	Free tier
baai/bge-m3	NVIDIA NIM	131K	Free tier

Typical Use Cases

llama2-70b use cases

Chat

llama2-70b is tagged for chat in this catalog and works with OpenAI-compatible client libraries.

FAQ

llama2-70b free API FAQ

Is llama2-70b free to use?

llama2-70b is listed with free API access on NVIDIA NIM, subject to the provider's quota and account policy.

What is the llama2-70b model ID?

The model ID shown in this catalog is meta/llama2-70b.

What are the llama2-70b free tier rate limits on NVIDIA NIM?

The listed free tier limit is Up to 40 RPM. Limits can change per account tier, so confirm against the provider dashboard.

What context window does llama2-70b support?

The listed context window is 131K tokens with up to 8K output tokens.

More about llama2-70b