llama-3.1-8b-instruct-fp8 Free API on Cloudflare Workers AI

Free API Verified

Available from Cloudflare Workers AI

★★★★★★★★★★ 3.5 Benchmark-backed score

Compact open Llama model for lightweight chat, drafting, and self-hosting

Free APIOpenAI compatibleTool callingJSON mode

Try in Playground Compare Save API Key

API Details

Copy-ready connection details

Use these values in your client or SDK.

Base URL

https://api.cloudflare.com/client/v4/accounts/{account_id}/ai/run

Model ID

@cf/meta/llama-3.1-8b-instruct-fp8

API format Cloudflare Workers AI native run + OpenAI Chat Completions

Technical Details

llama-3.1-8b-instruct-fp8 specifications

Provider and model catalog

Context window 8K

Max output 4K

Status Online

Family llama

Knowledge cutoff 2023-12

Released Jul 23, 2024

Last updated Jul 23, 2024

Free listing since Jul 23, 2024

Input text

Output text

Capabilities tool calling, structured output, temperature control

Open weights Yes

Weights Hugging Face

AI Recommendation

Should you use llama-3.1-8b-instruct-fp8?

llama-3.1-8b-instruct-fp8 is listed for chat workloads and supports a 8K context window.

Use it when Cloudflare Workers AI's free tier is enough for evaluation, demos, or light production traffic.

Best for

Chat

Strengths & Weaknesses

Strengths

Tool calling support
Structured JSON output
Open weights available
Live API verification available

Watch outs

Vision support is not listed

Benchmark Overview

Benchmark signals for llama-3.1-8b-instruct-fp8

Measured data

Intelligence General reasoning and instruction following

7.6/100

Coding Programming and code generation

5.4/100

Agentic Tool use and multi-step tasks

0.5/100

Context Maximum listed context window

Pricing

llama-3.1-8b-instruct-fp8 pricing per 1M tokens

Free tier listed

Input $0.152 per 1M tokens

Output $0.287 per 1M tokens

Free access Available Cloudflare Workers AI

Availability

llama-3.1-8b-instruct-fp8 availability by provider

2 alternatives

We found 3 provider listings for llama-3-1-8b-instruct. Check model ID, quota, pricing, and API format before switching providers.

Provider	Model listing	Access	Context	API	Limits
Cloudflare Workers AI	@cf/meta/llama-3.1-8b-instruct-fp8	Free tier	8K	Native	Varies
Hugging Face	Meta-Llama-3.1-8B-Instruct	Free tier	128K	Native	Credit-metered
NVIDIA NIM	meta/llama-3.1-8b-instruct	Free tier	8K	Native	Varies

View Cloudflare Workers AI setup guide →

Compare

llama-3.1-8b-instruct-fp8 alternatives to consider

Open comparison

Model	Provider	Context	Access
Meta-Llama-3.1-8B-Instruct	Hugging Face	128K	Free tier
meta/llama-3.1-8b-instruct	NVIDIA NIM	8K	Free tier
Mistral 7B	Cloudflare Workers AI	33K	Free tier
Qwen 1.5 7B	Cloudflare Workers AI	33K	Free tier
@cf/meta/llama-3.3-70b-instruct-fp8-fast	Cloudflare Workers AI	131K	Free tier

Typical Use Cases

llama-3.1-8b-instruct-fp8 use cases

Chat

llama-3.1-8b-instruct-fp8 is tagged for chat in this catalog and works with OpenAI-compatible client libraries.

FAQ

llama-3.1-8b-instruct-fp8 free API FAQ

Is llama-3.1-8b-instruct-fp8 free to use?

llama-3.1-8b-instruct-fp8 is listed with free API access on Cloudflare Workers AI, subject to the provider's quota and account policy.

What is the llama-3.1-8b-instruct-fp8 model ID?

The model ID shown in this catalog is @cf/meta/llama-3.1-8b-instruct-fp8.

What context window does llama-3.1-8b-instruct-fp8 support?

The listed context window is 8K tokens with up to 4K output tokens.

More about llama-3.1-8b-instruct-fp8