Skip to content
SolidRusT.ai

Introduction

Welcome to SolidRusT AI. OpenAI-compatible inference on a 14-node Kubernetes cluster we run ourselves — 5 of those nodes have GPUs.

  • OpenAI-compatible endpoints — point the official SDK at our base URL
  • Local GPU inference — chat on vLLM (vllm-primary)
  • Embeddings — dedicated vLLM serving Qwen/Qwen3-Embedding-0.6B
  • Data layer — RAG, keyword, hybrid, and graph under /data/v1/...

All API requests should be made to:

https://api.solidrust.ai/v1

RAG and ingestion use the same host with a /data prefix:

https://api.solidrust.ai/data/v1

Keys come from console.solidrust.ai. Status is status.solidrust.ai.

ModelTypeUse Case
vllm-primaryChatAlias for the current chat weights (Gemma 4 12B IT QAT, 16k context)
Qwen/Qwen3-Embedding-0.6BEmbeddingsSemantic search and RAG (1024-dim)