cpu-only

Minimal CPU-only Ollama Docker Image

Local agentic AI runtime optimized for CPU-only consumer hardware, tool use and efficient local inference.

CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.

🦙 chat-o-llama: A lightweight, modern web interface for AI conversations with support for both Ollama and llama.cpp backends. Features persistent conversation management, real-time backend switching, intelligent context compression, and a clean responsive UI.

CPU-only ONNX Runtime export and runtime workspace for VoxCPM2

An LLM-based content moderator. Firefox extension to block webpages unrelated to work, based on page title and URL. Local LLMs with Ollama and Langchain to ensure your browsing history never leaves your device, for complete privacy. Google Gemini also supported.

A high-performance Python library for extracting structured content from PDF documents with layout-aware text extraction. pdf_to_json preserves document structure including headings (H1-H6) and body text, outputting clean JSON format.

No-GPU 3D scanning from phone rotation videos — pure geometry, no neural networks, no cloud

Deterministic logical reasoning engine using Vector Symbolic Architectures. 100% ProofWriter. CPU-only. No backprop.

LCM-LoRA Studio - Create a high-quality image, in an average of ONLY 4 STEPS, using just a low-end CPU or a Raspberry Pi 5.

Fast CPU-only ROI detection library for real-time pipelines

Cascade MoE: a CPU-only expert system that turns plain-language sysadmin and networking questions into shell commands. No GPU, no cloud, no external model weights. Russian-first: 80% of held-out Russian queries answered with a working command, 38% in English. Patent pending. The benchmark that measures it ships with the source.

Probabilistic Signed Distance Fusion with View Planning on CPU

A self-hosted, fully autonomous, CPU-only poker-bot fleet for openpoker.ai — Rust workspace and React control room, every artifact machine-generated.

Adds deploy-ready FastAPI backend package with CPU model layout, docs, env examples, and tests.

Zero-memory, multi-core-CPU local AI training for ordinary laptops.

Free offline AI voice generator for Windows. One-click installer, no GPU, no API key, no account. Powered by Kokoro-82M - paste a script, get a 24 kHz WAV voiceover. Runs on any laptop CPU. Unlimited, private, no subscription.

Real-time text security pipeline for educational chat platforms — detects PII, self-harm signals, prompt injection & cyberattacks in ~30ms per message. Zero GPU, ~430MB RAM, no LLM calls.