Skip to content
View AyushSonuu's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report AyushSonuu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
AyushSonuu/README.md

Ayush Sonu

AI Engineer Β Β·Β  Backend Systems Β Β·Β  LLD / HLD Β Β·Β  Agentic AI Β Β·Β  RAG Pipelines

profile views


🧠 About Me

I build production-grade AI systems that combine modern LLM capabilities with robust backend engineering. My work sits at the intersection of AI infrastructure, distributed systems, and scalable architecture.

  • Designed and shipped agentic pipelines (LangGraph) for production AI applications
  • Built async backend services with FastAPI + PostgreSQL + Redis
  • Implemented an MCP host + intelligent tool routing layer with a Skills Protocol
  • Contributed to open-source LangGraph agent hosting infrastructure (Aegra)
  • Builds RAG pipelines with evaluation loops β€” LangFuse, LangSmith, Ragas
  • Thinks in system design β€” LLD patterns + HLD trade-offs, not just code

Reliable AI starts with reliable systems.


βš™οΈ Tech Stack

πŸ€– AI

LangChain LangGraph LangFuse LangSmith OpenAI HuggingFace

πŸ› οΈ Backend

Python FastAPI Pydantic SQLAlchemy Django Celery pytest

πŸ—„οΈ Data & Infra

PostgreSQL Redis Docker AWS GitHub Actions

πŸ” Vector & Search

Qdrant FAISS


πŸ’Ό Selected Work

πŸ”Ή MCP Host + Intelligent Tool Execution System MCP Β· Skills Protocol Β· LangGraph Β· FastAPI

  • Integrated an MCP host as a first-class feature inside a production AI system
  • Built a runtime tool discovery and routing layer that dynamically selects and executes the most relevant MCP tools for a task β€” no hardcoded routing
  • Implemented a Skills Protocol layer: higher-level skills compose MCP tools to perform multi-step workflows
  • Architecture: Task β†’ Skill β†’ MCP Tool(s) β†’ Result with runtime tool resolution

πŸ”Ή Enterprise RAG Platform FastAPI Β· LangGraph Β· PostgreSQL + pgvector Β· Redis Β· Qdrant

  • Hybrid retrieval (semantic + BM25) with metadata filtering
  • Streaming responses over SSE
  • Agent workflows with tool-use and planning
  • Evaluation pipeline via LangFuse + Ragas

πŸ”Ή Agentic Workflow Engine LangGraph Β· Redis pub/sub Β· Celery Β· FastAPI

  • Multi-agent orchestration with stateful memory
  • Async background task execution with Redis as Celery broker
  • Real-time status streaming to clients

πŸ”Ή Aegra β€” Open Source Contribution LangGraph Agent Protocol Β· Agent Hosting Infrastructure

  • Contributed to agent hosting layer for reliability at scale
  • Focused on production-grade agent serving patterns

⚑ Backend Architecture

              Client
                 β”‚
                 β–Ό
         FastAPI  (REST Β· SSE Β· Auth Β· Rate Limiting)
                 β”‚
     β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
     β–Ό           β–Ό            β–Ό
PostgreSQL     Redis        Celery Worker
(ACID Β· jsonb  (cache Β·      (background tasks)
 Β· pgvector)    session Β·         β”‚
                pub-sub Β·         β–Ό
                rate limit)   LLM APIs
                                  β”‚
                                  β–Ό
                             LangFuse / Eval

πŸ€– Agent System Architecture

          User Request
               β”‚
               β–Ό
         FastAPI API
               β”‚
               β–Ό
       LangGraph Runtime
               β”‚
     β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
     β–Ό         β–Ό          β–Ό
 Retrieval   Tools      Memory
     β”‚         β”‚          β”‚
     β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
          β–Ό
       LLM APIs
          β”‚
          β–Ό
   LangFuse / Eval

πŸ—οΈ System Design Depth

LLD                                    HLD
──────────────────────────────────     ──────────────────────────────────────
SOLID Principles                       Distributed System Principles
GoF Design Patterns                    Horizontal Scaling + Load Balancing
Clean Architecture                     Caching (Redis β€” cache-aside, write-through)
Repository / Service Layer             Message Queues (Celery + Redis / SQS)
Dependency Injection                   Database Design (Normalization, Indexing, Partitioning)
Domain-Driven Design                   API Gateway + Rate Limiting
Async / ASGI Internals                 CAP Theorem & eventual consistency

🌱 Currently Exploring

AI Runtime Architecture Β Β·Β  ASGI Internals Β Β·Β  Kafka / Redpanda
Kubernetes Β Β·Β  Event-driven Architectures Β Β·Β  Distributed Systems


🎯 Interested In

AI Infrastructure Β Β·Β  Agent Runtime Design Β Β·Β  MCP Β Β·Β  Vector Search Β Β·Β  Retrieval Systems


πŸ“Š GitHub Stats

Β Β 


🌍 Connect


"Reliable AI starts with reliable systems."

Popular repositories Loading

  1. credit-card-default-ML-classification-capstone credit-card-default-ML-classification-capstone Public

    Jupyter Notebook 2

  2. Mine_Sweeper_mini_project Mine_Sweeper_mini_project Public

    creating a command line mine sweeper game in java

    Java 2 1

  3. examserver examserver Public

    Online Exam System

    Java 2

  4. git-pratice git-pratice Public

    practing git commands

    1

  5. Assignment_1-python-basics Assignment_1-python-basics Public

    1