Production notes on Kubernetes, OpenShift, and OVHcloud: observability, log archiving, service mesh, LLM inference, and digital sovereignty. Zola 2026-06-27T00:00:00+00:00 https://blog.none.at/tags/zed/atom.xml 2026-06-02T00:00:00+00:00 2026-06-27T00:00:00+00:00 aleks https://blog.none.at/blog/2026/2026-06-02-llm-inference-on-ovh-agents/

<p>The first four parts of this series deployed a vLLM inference endpoint at <code>https://llm.YOUR_DOMAIN/v1</code>, protected by a Bearer token, running on an OVH RTX5000-28 GPU node. This part shows how to connect coding assistants, web UIs, and other OpenAI-compatible clients to that endpoint.</p>