Skip to content
View kylebrodeur's full-sized avatar
👨‍🏭
Building
👨‍🏭
Building

Block or report kylebrodeur

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
kylebrodeur/README.md

Kyle Brodeur: AI educator and systems builder, builder's notes on useful systems

Kyle Brodeur

AI educator and systems builder at U of Digital. Builder's notes on useful systems, published weekly with the receipts left in.

The Modal Toolkit

A family of open-source GPU servers on Modal, plus one operator CLI that runs the whole fleet. The runbooks are war stories, not checklists.

Package What it does
modal-toolkit The operator CLI: init, pull, deploy, doctor, dashboard, cost
modal-inference-server OpenAI-compatible GPU inference with hot-set routing
modal-embedding-server GPU embeddings with a sync protocol and model-selection evals
modal-vision-server Classification and segmentation driven by a model card
modal-finetune-server LoRA fine-tune, merge to GGUF, honest eval gates
modal-vault-server A hosted vault and MCP memory plane for agents
modal-victoriametrics-server Single-node VictoriaMetrics, CPU only, scale to zero
modal-shared-libs Stdlib-first shared modules, vendored into every package

There is a paid side too: a Modal Production Operator Kit and a set of architecture services, for teams that want the work done with me rather than handed to them.

Agent tooling

Shared bash primitives for machine hygiene, an MCP server for capturing and analyzing browser traffic, a model router that picks the right model tier per turn, and a way to run a second coding agent as a persistent service.

  • pi-link - a local WebSocket network for coordinating Pi coding-agent terminals
  • pi-model-router - an intelligent per-turn model router

Elsewhere

Building notes on useful systems, mostly. The receipts are in the repos.

Pinned Loading

  1. modal-toolkit modal-toolkit Public

    One operator CLI for the full Modal Toolkit: deploy, warm, doctor, shutdown, cost, and flows across embedding, inference, vision, and finetune.

    Python

  2. embed-eval-on-your-vault embed-eval-on-your-vault Public

    Pick the embedding model from your own corpus. Single-file Python eval harness. Companion to 'Pick the Model From Your Own Data' (kylebrodeur.substack.com).

    Python

  3. reelbinder reelbinder Public

    A filmmaking workspace from screenplay to portable cut.

    TypeScript

  4. storybook-addon-annotations storybook-addon-annotations Public

    Visual annotations and threaded review comments for Storybook, anchored to components or text ranges.

    TypeScript

  5. pi-model-discovery pi-model-discovery Public

    Auto-discover local model providers (Ollama) and register their models with Pi on startup. Per-model context windows and capabilities, no /reload required.

    TypeScript 4 1