SigNoz on OVH MKS: Infrastructure with Terraform + Ansible
Deploy SigNoz on OVH MKS with Terraform and Ansible: MKS cluster, ClickHouse hot-to-cold S3 tiering, Istio Ambient Mode, cert-manager DNS-01. Part 1 of 3.
LLM Inference on OVH MKS: Connect IDEs and Web UIs
Connect Continue.dev, Zed, Cline, Open WebUI, and ownCloud Infinite Scale to a self-hosted vLLM endpoint on OVH MKS. Per-client setup guide. Part 5 of 6.
LLM Inference on OVH MKS: Terraform, Ansible, and Deployment
Provision an OVH MKS GPU node pool with Terraform, deploy vLLM, Istio, and cert-manager with Ansible, and walk through a first deployment. Part 2 of 6.
LLM Inference on OVH MKS: LiteLLM API Gateway
LiteLLM gateway on top of vLLM: per-user API keys, budget limits, and automatic fallback to commercial APIs when the local GPU node is cold. Part 6 of 6.
LLM Inference on OVH MKS: Introduction
When to self-host an LLM on Kubernetes, why vLLM, and what the stack looks like on OVH MKS. Covers use cases, cost framing, and architecture. Part 1 of 6.
LLM Inference on OVH MKS: Prometheus, Grafana, and KEDA
Scrape vLLM and DCGM metrics with kube-prometheus-stack, visualise TTFT and tokens/s in Grafana, and autoscale to zero with KEDA. Part 4 of 6.
LLM Inference on OVH MKS: Models, AWQ, and OpenAI API
Which models fit on a 16 GB GPU, why AWQ is required for 7B+ models on the RTX5000-28, and how to use the OpenAI-compatible API from Python. Part 3 of 6.
SigNoz on OVH MKS: Metrics, Traces & Logs with Istio Ambient
Send Istio metrics, OTLP traces, and pod logs to SigNoz on OVH MKS. Verify ClickHouse S3 cold-tier and estimate 7-year storage costs. Part 2 of 3.
SigNoz on OVH MKS: Access Log Reports with Vector and ClickHouse
Collect Envoy access logs with Vector into ClickHouse, generate monthly awffull reports, and serve them via Istio ExternalName route to S3. Part 3 of 3.
AWS vs. GCP vs. Azure vs. OVHcloud: Log Archiving Operations
Kubernetes logging, ingest pipeline options, backup, DR, and pipeline observability across AWS, GCP, Azure, and OVHcloud. Part 3 of 6.