Skip to content
@smg-project

smg-project

Pinned Loading

  1. smg smg Public

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…

    Rust 732 229

  2. smg-docs smg-docs Public

    (SMG) Shepherd Model Gateway official documentation, designed by studio-noiich.

    Python 3 4

  3. smg-dev-guide smg-dev-guide Public

    Shepherd Model Gateway Claude Code Skills

    Python 13 2

  4. bellwether bellwether Public

    Token-level conformance for SMG: does the gateway render the same prompt tokens and parse the same response as the model vendor's reference, vLLM and SGLang, with no GPU

    Python 3 1

Repositories

Showing 8 of 8 repositories
  • smg Public

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

    smg-project/smg's past year of commit activity
    Rust 732 Apache-2.0 229 52 150 Updated Nov 19, 2026
  • smg-docs Public

    (SMG) Shepherd Model Gateway official documentation, designed by studio-noiich.

    smg-project/smg-docs's past year of commit activity
    Python 3 4 0 12 Updated Nov 19, 2026
  • artifacts Public
    smg-project/artifacts's past year of commit activity
    1 Apache-2.0 0 0 2 Updated Nov 19, 2026
  • bellwether Public

    Token-level conformance for SMG: does the gateway render the same prompt tokens and parse the same response as the model vendor's reference, vLLM and SGLang, with no GPU

    smg-project/bellwether's past year of commit activity
    Python 3 Apache-2.0 1 25 4 Updated Nov 16, 2026
  • smg-dev-guide Public

    Shepherd Model Gateway Claude Code Skills

    smg-project/smg-dev-guide's past year of commit activity
    Python 13 Apache-2.0 2 1 0 Updated Nov 8, 2026
  • llm-multimodal Public

    Rust multimodal preprocessing library from SMG

    smg-project/llm-multimodal's past year of commit activity
    Rust 9 Apache-2.0 15 2 6 Updated Oct 27, 2026
  • deepseek-provider-verifier Public

    Verify Deepseek API compatibility and deployment quality across providers, inference engines, and gateways

    smg-project/deepseek-provider-verifier's past year of commit activity
    Python 0 MIT 1 0 1 Updated Oct 6, 2026
  • smg-project/providers-verifier's past year of commit activity
    Python 3 0 0 0 Updated Sep 30, 2026

Top languages

Python Rust

Most used topics

Loading…