Insights · Research · Field Notes

Enterprise AI, explained for builders and buyers. Page 7 of 29

Practical writing on governed agent orchestration, on-premise AI, compliance, and the infrastructure decisions that separate pilot projects from production platforms.

261 Articles
39 Topics
12 Featured
Six dark equipment cabinets in two rows against a whitewashed wall, each threaded with orange and blue cables and lit by status lights, like the GPU nodes of a small Kubernetes cluster wired into one system
AI Infrastructure 11 min read

Hosting an LLM on Kubernetes: GPU Nodes, Model Storage, Serving and Autoscaling

A vendor-neutral guide to hosting a large language model on Kubernetes: preparing GPU nodes with the NVIDIA GPU Operator, getting weights to the pods, choosing between vLLM's Helm chart, KServe, llm-d and the NIM Operator, scaling on queue depth, and running the whole stack without internet access.

#Kubernetes#vLLM#local LLM
Read article
Bundles of blue network cables plugged into rows of rack-mounted switches, standing in for the gateway that routes every application's model calls
AI Infrastructure 12 min read

LiteLLM Alternatives in 2026: Open-Source, Self-Hosted and Enterprise LLM Gateways

For teams already running LiteLLM: what its own documentation says about enterprise licensing, operations, performance and the March 2026 PyPI incident, and how Portkey, Bifrost, agentgateway, Agent Router, Apache APISIX, Kong, OpenRouter and Cloudflare compare. Verified October 2026.

#AI gateway#LLM gateway#model routing
Read article
Rack-mounted equipment with rows of cable sockets, a lit button panel and a small screen glowing green in a dark equipment room, standing in for the in-house hardware a self-hosted Llama deployment runs on
AI Infrastructure 13 min read

Llama On-Premise: Licence, GPU Sizing and Serving for Llama 4 and Llama 3.3

Meta has not released a new Llama model since April 2025, yet Llama 4 Scout, Llama 4 Maverick and Llama 3.3 70B remain common choices for self-hosting. This guide covers the current lineup, the licence terms that bind an enterprise (including the EU carve-out for multimodal models), GPU sizing from the published configs, serving with vLLM, llama.cpp or Ollama, and when another open family is the better fit.

#Llama#open-weight models#local LLM
Read article
An engineer at an office desk working on a laptop in front of a larger monitor full of code, the kind of screen where LLM traces, token counts and latency charts get read
AI Infrastructure 11 min read

LLM Observability Tools in 2026: Open-Source and Commercial Platforms Compared

LLM observability tools checked against their own docs and repositories: Langfuse, Arize Phoenix, OpenLLMetry and the OpenTelemetry GenAI conventions, MLflow, LangSmith, Datadog, Grafana, Helicone and W&B Weave, compared on self-hosting, licence, OpenTelemetry, evals, cost and PII handling. Verified October 2026.

#AI observability#AI audit trails#AI evaluation
Read article
Rack-mounted network appliances with status lights and patch cables in a dark equipment cabinet, standing in for the gateway that sits between AI agents and the tool servers they call
AI Infrastructure 14 min read

MCP Gateway Comparison 2026: Open-Source, AWS, Azure, Docker and Kong Options

How an MCP gateway differs from an MCP server and a registry, and ten gateways and portals for agent tool traffic checked against their own documentation for hosting, OAuth, tool allowlists, audit, rate limits and licence. Verified October 2026.

#MCP gateway#Model Context Protocol#MCP security
Read article
A technician in a high-visibility vest checks a rack of network equipment with a handheld test device, representing the network and information systems that NIS2 requires essential and important entities to secure
AI Compliance 12 min read

NIS2 and AI: What the Directive Requires of AI Systems and AI Vendors, and NIS2 vs the AI Act

NIS2 has no article about AI, yet an AI assistant or agent run by an essential or important entity is part of its network and information systems, and the company supplying it is part of its supply chain. This guide maps Articles 20, 21 and 23 onto AI, compares NIS2 with the EU AI Act, gives the transposition picture as of October 2026 and ends with a checklist.

#AI compliance#AI security#EU AI Act
Read article
Tall stacks of paper files and folders flagged with yellow sticky notes on a desk under office ceiling lights, the kind of backlog an on-premise document AI pipeline is built to read
AI Infrastructure 11 min read

On-Premise Document AI: Azure, Google, SAP, Mistral and Open-Source Options Compared

Which document AI services run on premise in October 2026, what each one requires, and how open models such as PaddleOCR, Docling, olmOCR and DeepSeek-OCR compare on licence, layout and tables, handwriting, languages and hardware, with a selection checklist for intelligent document processing.

#on-premises AI#document automation#open-source AI
Read article
Two microphones on boom arms and two pairs of headphones on a wooden table in a glass-walled office room, standing in for the capture and playback ends of a voice AI system that stays inside the building
AI Infrastructure 11 min read

On-Premise Voice AI: Speech Recognition, LLMs and Text to Speech on Your Own Servers

How an on-premise voice AI stack fits together in 2026: the open speech recognition and text-to-speech models worth shortlisting, their licences, the latency budget for a spoken turn, hardware sizing and a deployment checklist.

#on-premises AI#local AI infrastructure#open-weight models
Read article
Six colleagues working on laptops around a conference table in a high-rise office, the kind of group a shared, self-hosted chat interface has to serve with separate accounts and permissions
Implementation Guide 10 min read

Open WebUI vs LibreChat vs AnythingLLM: Self-Hosted Chat Interfaces Compared (2026)

Open WebUI, LibreChat and AnythingLLM all put a ChatGPT-style interface in front of models you host. This comparison covers what each licence allows, how each one signs people in and assigns roles, how it handles documents, agents and MCP tools, how it deploys and what it logs, plus a note on LM Studio and the point at which a company needs more than a chat interface.

#Open WebUI#LibreChat#AnythingLLM
Read article
Stay ahead of enterprise AI

Turn insight into an on-prem AI roadmap.

Pair these articles with a product walkthrough to see how VDF AI handles orchestration, governance, and cost control inside your own infrastructure.