MCP Server · AI & ML

rai

CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.

Tier 1 sealed by lossy-channel-auto
Source
https://github.com/classeve-public/rai
Registry namespace
io.github.classeve-public/rai
Imported from
github-topics
License
Apache-2.0
Pricing
Open Source
Added
Jul 25, 2026

Seal evidence

Auto-sealed Tier 1 on import from GitHub topic search. Lossy Channel layers 1–2 to be backfilled by the Foreman.

  • L1-wash

Similar tools