ai/gpt-oss-vllm

Verified Publisher

By Docker

Updated 9 months ago

OpenAI’s open-weight models designed for powerful reasoning, agentic tasks

Model
2

10K+

ai/gpt-oss-vllm repository overview

GPT‑OSS

Welcome to the gpt-oss series, OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases.

Use this AI model with Docker Model Runner

Run the model:

docker model run ai/gpt-oss-vllm

Highlights

  • Permissive Apache 2.0 license: Build freely without copyleft restrictions or patent risk—ideal for experimentation, customization, and commercial deployment.
  • Configurable reasoning effort: Easily adjust the reasoning effort (low, medium, high) based on your specific use case and latency needs.
  • Full chain-of-thought: Gain complete access to the model’s reasoning process, facilitating easier debugging and increased trust in outputs. It’s not intended to be shown to end users.
  • Fine-tunable: Fully customize models to your specific use case through parameter fine-tuning.
  • Agentic capabilities: Use the models’ native capabilities for function calling, web browsing, Python code execution, and Structured Outputs.
  • MXFP4 quantization: The models were post-trained with MXFP4 quantization of the MoE weights, making gpt-oss-120b run on a single 80GB GPU (like NVIDIA H100 or AMD MI300X) and the gpt-oss-20b model run within 16GB of memory. All evals were performed with the same MXFP4 quantization.

Considerations

  • CoT and tool calling are not supported

Tag summary

Content type

Model

Digest

sha256:a82ec1eae

Size

8.4 GB

Last updated

9 months ago

docker model pull ai/gpt-oss-vllm

This week's pulls

Pulls:

183

Last week