← Current Platform / hardware

Dedicated inference

RTX 5090 AI workstation

Alpha-5 turns dedicated GPU hardware into a complete private inference and retrieval platform.

RTX 5090vLLMOpen WebUILibreChat

01 / Why it exists

Local AI becomes dependable only when serving, retrieval, memory, search, and tools are treated as one system.

02 / Architecture

Ubuntu and Docker host vLLM on an RTX 5090 with 32 GB VRAM. LibreChat and Open WebUI provide interfaces; retrieval, search, databases, and MCP services surround the model server.

03 / Lessons

What operation taught me.

  1. 01The GPU attracts attention; the surrounding platform creates usefulness.
  2. 02Model serving and product experience should remain separate boundaries.

Screenshots

Operational captures will be added when they can be safely published.

Source / Config

Public configuration will appear here when the boundary is ready.