Skip to content
@doublewordai

doublewordai

Popular repositories Loading

  1. autobatcher autobatcher Public

    Drop-in AsyncOpenAI replacement that transparently batches requests

    Python 24 5

  2. deepseek-reddit-agent deepseek-reddit-agent Public

    An example notebook which shows how you can build a LLM agent that scrapes information from Reddit and summarize key bullets using a self-hosted DeepSeek-R1-Distill-Llama-8B deployed with Titan Tak…

    Jupyter Notebook 13 2

  3. zerodp zerodp Public

    ZeroDP implements an efficient zero-copy data parallel approach for serving Mixture-of-Experts (MoE) models, where expert weights are shared across data parallel ranks via CUDA IPC (Inter-Process C…

    Python 11 3

  4. inference-stack inference-stack Public

    The Doubleword Inference Stack is the easiest & most performant way to run genAI infrastructure in your private environment.

    Go Template 10 3

  5. llmux llmux Public

    LLM multiplexer for vLLM - host multiple models on a single GPU with zero-reload switching

    Rust 10 4

  6. doubleword-skill doubleword-skill Public

    Claude Code skill for working with the Doubleword Batch API

    5 2

Repositories

Showing 10 of 73 repositories

Most used topics

Loading…