https://blog.none.at Production notes on Kubernetes, OpenShift, and OVHcloud: observability, log archiving, service mesh, LLM inference, and digital sovereignty. Zola en Sat, 27 Jun 2026 00:00:00 +0000 Tue, 02 Jun 2026 00:00:00 +0000 aleks https://blog.none.at/blog/2026/2026-06-02-llm-inference-on-ovh-agents/ https://blog.none.at/blog/2026/2026-06-02-llm-inference-on-ovh-agents/ <p>The first four parts of this series deployed a vLLM inference endpoint at <code>https://llm.YOUR_DOMAIN/v1</code>, protected by a Bearer token, running on an OVH RTX5000-28 GPU node. This part shows how to connect coding assistants, web UIs, and other OpenAI-compatible clients to that endpoint.</p>