Docker has up to date Compose with new options that can make it simpler for builders to construct, ship, and run AI brokers.
Builders can outline open fashions, brokers, and MCP-compatible instruments in a compose.yaml file after which spin up an agentic stack with a single command: docker compose up.
Compose integrates with a number of agentic frameworks, together with LangGraph, Embabel, Vercel AI SDK, Spring AI, CrewAI, Google’s ADK, and Agno.
It additionally now integrates with Google Cloud Run and Microsoft Azure Container Apps Service, permitting brokers to be deployed to serverless environments.
Moreover, the corporate introduced Docker Offload, which permits builders to dump compute-intensive workloads to high-performance cloud environments. “Construct, take a look at, and scale your agentic functions similar to you at all times have domestically, whereas Docker handles the heavy lifting behind the scenes,” Mark Cavage, president and COO of Docker, and Tushar Jain, EVP of engineering and product at Docker, wrote in a weblog put up.
The corporate is at the moment providing 300 minutes of free Offload utilization in order that customers can strive it out.
Different helpful Docker capabilities for constructing brokers embody the MCP Catalog for locating instruments that may be related to brokers, and Mannequin Runner, which lets builders pull open-weight LLMs from Docker Hub, run them domestically, and work together with them utilizing OpenAI-compatible endpoints.
“The way forward for software program is agentic, the place each developer builds goal-driven, multi-LLM brokers that cause, plan, and act throughout a wealthy ecosystem of instruments and providers. With Docker Compose, Docker Offload, Docker’s broader AI capabilities, and our partnerships with Google, Microsoft, and Agent SDKs, we’re making that future accessible to, and straightforward for, everybody,” Cavage and Jain wrote.