Docker Model Runner
-
Introducing a Richer ”docker model run” Experience
New interactive prompt for docker model run: readline-style editing, history, multi-line input, and Ctrl+C to stop responses. Try it today!
Read now
-
Docker Model Runner Meets Open WebUI: A Simpler Way to Run Local AI Models
Use the Open WebUI extension for Docker Desktop to run local LLMs with Docker Model Runner—chat UI, file uploads, voice, and multi-model support in minutes.
Read now
-
Join Us in Revitalizing the Docker Model Runner Community!
Docker Model Runner is GA, now in all Docker versions with Vulkan support for nearly any GPU. Star, fork, and contribute in our unified repo.
Read now
-
Docker Model Runner on the new NVIDIA DGX Spark: a new paradigm for developing AI locally
We’re thrilled to bring NVIDIA DGX™ Spark support to Docker Model Runner. The new NVIDIA DGX Spark delivers incredible performance, and Docker Model Runner makes it accessible. With Model Runner, you can easily run and iterate on larger models right on your local machine, using the same intuitive Docker experience you already trust. In this…
Read now
-
LoRA Explained: Faster, More Efficient Fine-Tuning with Docker
LoRA is a method that freezes a base model and adds trainable adapters to teach pre-trained models new behaviors, without overwriting their existing knowledge.
Read now
-
Unlocking Local AI on Any GPU: Docker Model Runner Now with Vulkan Support
Run local LLMs on more GPUs with Docker Model Runner. New Vulkan support accelerates AMD, Intel, and integrated GPUs—auto-detects hardware with CPU fallback.
Read now
-
IBM Granite 4.0 Models Now Available on Docker Hub
Developers can now discover and run IBM’s latest open-source Granite 4.0 language models from the Docker Hub model catalog, and start building in minutes with Docker Model Runner. Granite 4.0 pairs strong, enterprise-ready performance with a lightweight footprint, so you can prototype locally and scale confidently. The Granite 4.0 family is designed for speed, flexibility,…
Read now
-
Llama.cpp Gets an Upgrade: Resumable Model Downloads
New: resumable GGUF downloads in llama.cpp. Learn how Docker Model Runner makes models versioned, shareable, and OCI-native for seamless dev-to-prod
Read now