Building an AI Gateway to centralise common LLM use case cross functional requirements, to accelerate LLM product development.| karlstoney.com
Upgrading all our sidecar containers to Kubernetes Native Sidecars, including cloudsql-proxy and istio-proxy.| karlstoney.com
The default retry configuration on Istio is not safe, and can retry requests you may not want retrying!| karlstoney.com
Upgrading Istio from 1.20 to 1.21. Issues with JWT auth in dynamicMetadata and AuthorizationPolicies.| karlstoney.com
How to transparently compress response traffic between your microservices, consistently, using EnvoyFilters in Istio| karlstoney.com
How to use llama-2 7b to generate summaries of your incidents, using Cloudflare workers and Workers AI. Including Pirate mode.| karlstoney.com
Evolution of Alerting and Incident Management: Navigating Chaos in a Remote Work Era. From Desk Huddles to Digital Collaboration and how we adapted.| karlstoney.com
The challenges of Auto Scaling, from cold start impact, tech debt, and cost realities. Prioritising scaling as code and shared responsibility for optimal performance in cloud efficiency.| karlstoney.com
Scaling Istio Sidecars, and how we consider the relationship of Sidecar resources tightly coupled to the application.| karlstoney.com
How to improve the performance of Jaeger when using Elasticsearch as the storage backend.| karlstoney.com
Exploring how to do anomaly alerting on seasonal data in Prometheus.| karlstoney.com
How to enable GZIP compression of responses using EnvoyFilter| karlstoney.com
How to migrate your Istio deployment to the new Telemetry API| karlstoney.com
Capturing, validating, storing and discovering service metadata. Keeping that metadata consistent across numerous integration points.| karlstoney.com
Using Istio, Kubernetes and Prometheus to build dynamically scaling infrastructure that can scale unused workloads to zero.| karlstoney.com
Using EnvoyFilter to debug HTTP requests, and locate those missing important tracing headers| karlstoney.com
Storing rich metadata as Custom Resources on the Kubernetes API to enable Service Discovery.| karlstoney.com
How we build, test and release Istio across 5 environments using a custom release process + chart.| karlstoney.com
Some good news! 1.8 and 1.9 were a lot less painful than previous releases, so I bundled them into a single blog post. Remember that you shouldn't skip-version upgrade so if you're still on 1.7, go through 1.8 to 1.9. This blog will cover the| karlstoney.com