Docker enhances Compose with AI agents and GPU cloud Offload

Docker has announced significant updates to its platform, including AI agent support in Docker Compose and a new GPU-powered Offload service designed for compute-intensive AI workloads in ephemeral cloud environments.

AI Agent Support in Docker Compose

Docker Compose, a tool for defining and running multi-container applications, now supports AI agents, models, and tools to run agentic workloads. This enhancement allows deployment to cloud container services, starting with Google Cloud Run. For example, developers can use the command:

gcloud run compose up

where gcloud is the Google Cloud CLI. Support for Azure Container Apps is coming soon, though AWS support remains unmentioned. The update also includes compatibility with AI orchestration frameworks like CrewAI, LangGraph, and Spring AI.

Docker Offload: GPU-Powered Cloud Service

Docker has also previewed Docker Offload, a remote compute and build service now in closed beta. This service, similar to Docker's existing Build Cloud, adds Nvidia L4 Tensor Core GPUs for AI workloads. Key features include:

• Cloud builds and ephemeral cloud runners
• Hybrid workflows combining local and remote compute
• Port forwarding and bind mounts for a local-like experience
• Compatibility with buildx and build CLI commands
• Multi-platform output support

Docker Offload requires Docker Desktop and a Pro account or higher. Pricing is based on minutes, though exact costs are not yet disclosed. For context, Docker Build Cloud starts at $25 for 500 minutes, but Offload may be pricier due to GPU support.

Limitations and Considerations

• Regional availability: Currently, Docker Offload only uses the US East region, potentially causing latency for users elsewhere.
• Security concerns: While Docker promotes ephemeral environments for isolation, risks remain with AI agents executing security-critical tasks without human oversight. Docker's MCP Gateway offers a curated catalog of tools, but malicious prompts remain a challenge.