Should you use llama-3.1-8b-instruct-fp8?
llama-3.1-8b-instruct-fp8 is listed for chat workloads and supports a 8K context window.
Use it when Cloudflare Workers AI's free tier is enough for evaluation, demos, or light production traffic.
https://api.cloudflare.com/client/v4/accounts/{account_id}/ai/run @cf/meta/llama-3.1-8b-instruct-fp8 llama-3.1-8b-instruct-fp8 is listed for chat workloads and supports a 8K context window.
Use it when Cloudflare Workers AI's free tier is enough for evaluation, demos, or light production traffic.
We only found this llama-3-1-8b-instruct listing on Cloudflare Workers AI in the current catalog. Use the related models section for nearby alternatives.
| Provider | Model listing | Access | Context | API | Limits |
|---|---|---|---|---|---|
| | @cf/meta/llama-3.1-8b-instruct-fp8 | Free tier | 8K | Native | Varies |
| Model | Provider | Context | Access |
|---|---|---|---|
| Mistral 7B | Cloudflare Workers AI | 33K | Check provider |
| Qwen 1.5 7B | Cloudflare Workers AI | 33K | Check provider |
| @cf/meta/llama-3.3-70b-instruct-fp8-fast | Cloudflare Workers AI | 24K | Free tier |
| @cf/meta/llama-4-scout-17b-16e-instruct | Cloudflare Workers AI | 131K | Free tier |
| @cf/openai/gpt-oss-120b | Cloudflare Workers AI | 128K | Free tier |
llama-3.1-8b-instruct-fp8 is tagged for chat in this catalog and works with OpenAI-compatible client libraries.
llama-3.1-8b-instruct-fp8 is listed with free API access on Cloudflare Workers AI, subject to the provider's quota and account policy.
The model ID shown in this catalog is @cf/meta/llama-3.1-8b-instruct-fp8.
llama-3.1-8b-instruct-fp8 is scheduled for retirement on 2026-11-20. After that date, requests will return HTTP 410 Gone (Error 5028). The recommended official alternative is Llama 3.3 70B Instruct.
The listed context window is 8K tokens with up to 4K output tokens.
Compact open Llama model for lightweight chat, drafting, and self-hosting
For API keys, setup steps, and provider-level limits, see the Cloudflare Workers AI provider page.