An empowerer of engineers, Layer5 helps you extract more value from your infrastructure. Creator and maintainer of cloud native standards. Maker of Meshery, the cloud native manager.| layer5.io
| layer5.io
Collaboratively design and manage your Kubernetes workloads and Cloud services, infrastructure, and cloud native apps. Confidently configure your systems with Kanvas's visual topology and built-in design patterns.| layer5.io
Over the course of this series, we've embarked on a deep technical dive into Docker Model Runner, moving beyond surface-level descriptions to uncover the engineering principles and practical implications of this innovative toolkit. From its foundational architecture to its integration with the broader developer ecosystem, Model Runner presents a compelling vision for the future of local AI development. In this concluding post, we'll synthesize the key engineering takeaways and explore the pro...| Layer5 Technical Posts
In our ongoing exploration of Docker Model Runner, we've covered its OCI-based model management, performance architecture, OpenAI-compatible API, and Docker Compose integration. Now, we turn to a specific, yet highly impactful, synergy: how Docker Model Runner empowers Java developers using the Spring AI framework to seamlessly incorporate local Large Language Models (LLMs) into their applications.| Layer5 Technical Posts
So far in our series on Docker Model Runner, we've dissected its OCI-based model management, its performance-optimized execution architecture, and its OpenAI-compatible API. Now, we explore a feature that truly elevates its utility for engineers building complex systems: deep integration with Docker Compose via a novel provider service type.| Layer5 Technical Posts
In our series on Docker Model Runner, we've explored Docker Model Runner's role in simplifying local AI development and its strategic use of OCI artifacts for model management. Now, we peel back another layer to examine a critical aspect for any engineer working with Large Language Models (LLMs): performance. How does Docker Model Runner achieve the responsiveness needed for an efficient local development loop? The answers lie in its architectural choices, particularly its embrace of host-nat...| Layer5 Technical Posts
In our last post in this series, explored Docker Model Runner's OCI-based model management and its performance-centric execution model, we now turn our attention to another critical area for engineers: its API architecture and connectivity options. How do your applications actually talk to the models running locally via Model Runner? The answer lies in a thoughtfully designed API layer, with OpenAI compatibility at its core, and flexible connection methods to suit diverse development scenario...| Layer5 Technical Posts
In our [previous post](https://layer5.io/blog/docker/docker-model-runner), we introduced Docker Model Runner as a promising new toolkit for simplifying local AI development. Now, let's delve into one of its foundational—and perhaps most strategically significant—aspects: its deep reliance on the Open Container Initiative (OCI) standard for managing AI models.If you've wrestled with AI models, you know the "messy landscape" of model distribution. Models often arrive as loose files, tucked ...| Layer5 Technical Posts
Expect more from your infrastructure. Cloud native, open source software for your cloud native infrastructure and applications. Allowing developers to focus on business logic, not infrastructure concerns. Empowering operators to confidently run modern infrastructure.| layer5.io
Meet the Maintainer series with open source maintainer, Ian Whitney| layer5.io
Layer5 announces Kanvas, a collaboration platform for engineering teams managing cloud native infrastructure. Built on Meshery, Kanvas provides an intuitive design suite for engineers to visualize, manage, and collaboratively design multi-cloud and Kubernetes-native infrastructure.| Layer5 Technical Posts
A comprehensive guide to the Kanvas Catalog, a collection of curated, pre-built, and ready-to-use cloud and cloud native infrastructure configurations.| Layer5 Technical Posts
Meet the Maintainer series with open source maintainer, Yash Sharma| Layer5 Technical Posts
Linting Dockerfiles. Docker build fails with warning: FromAsCasing: ‘as’ and ‘FROM’ keywords’ casing do not match. Learn how to fix this and other build check warnings.| Layer5 Technical Posts
Meet the Maintainer series with open source maintainer, Aisuko Li| Layer5 Technical Posts
Meet the Maintainer series with open source maintainer, Hussaina Begum| Layer5 Technical Posts
Meet the Maintainer series with open source maintainer, Aadhitya Amarendiran| Layer5 Technical Posts
Meet the Maintainer series with open source maintainer, Xin Huang| Layer5 Technical Posts
Celebrating Meshery's 5,000 GitHub Star Milestone| Layer5 Technical Posts
Git command line aliases and git shortcuts| layer5.io
