Skip to content
View RajuRoopani's full-sized avatar
🎯
.
🎯
.
  • Microsoft
  • Redmond, WA

Block or report RajuRoopani

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
RajuRoopani/README.md

Hi, I'm Raju Roopani πŸ‘‹

AI Software Engineer Β· Agentic Systems, LLM Platforms & Distributed Systems


AI Software Engineer and tech lead with 14+ years building and operating large-scale distributed systems serving hundreds of millions of users. Specialized in agentic AI systems β€” multi-agent orchestration runtimes, LLM tool-use and function calling, Model Context Protocol (MCP) integrations, agent-to-agent (A2A) communication, RAG pipelines, memory systems, and evaluation loops. Strong foundation in event-driven architecture, fault tolerance, idempotency, and horizontal scalability. Proven track record taking AI products from 0β†’1 concept through GA, and making binding architectural decisions in ambiguous, fast-moving environments. Passionate about shipping reliable, low-latency AI that measurably improves user productivity at scale.

  • πŸ”­ Currently: Principal Software Engineer Β· AI Tech Lead @ Microsoft AI (Teams Platform) β€” building agent APIs, SDKs, and the multi-agent orchestration runtime that serves 300M+ daily active users.
  • 🌐 Portfolio & deep dive: rajuroopani.github.io

πŸ› οΈ What I work on

  • Agent Extensibility Platform & Orchestration Runtime β€” Tech lead for Agent APIs, SDKs, and client experiences that let internal and external developers build production-grade agentic systems in Teams. Architected and delivered a real-time distributed multi-agent orchestration runtime supporting A2A, MCP, at-mention, context propagation, turn-taking protocols, and human-in-the-loop intervention β€” event-driven, with partial-failure isolation, idempotent retries, and horizontal scale-out delivering reliable, low-latency AI interactions to 300M+ Teams DAU.
  • Teams Meetings Platform Framework & SDK β€” Led integration of AI agents into Teams Meetings, providing real-time insights and contextual assistance to millions of daily active users.
  • Cross-Functional Technical Leadership β€” Scope ambiguous work independently, evaluate build-vs-buy trade-offs, and make binding architectural decisions across Engineering, Product, Design, and AI Research without escalation.
  • Modern Project Online (project.microsoft.com) β€” Full-stack architecture and delivery of a cloud-native collaborative platform on React/TypeScript, GraphQL, and Azure for millions of enterprise users; cut page-load time 30% via virtualization, memoization, and batch-update strategies.

πŸ“Š Selected impact

Metric
300M+ Teams daily active users served
10M+ financial transactions/day (Yodlee aggregation platform)
30% Project Online page-load reduction
~60% manual verification effort reduced (ARM build tooling)
14+ yrs large-scale distributed systems & platform engineering

πŸ’Ό Experience

  • Microsoft AI β€” Principal Software Engineer Β· AI Tech Lead, Teams Platform Β· Jul 2018 – Present
  • Envestnet Yodlee β€” Member of Technical Staff, Platform Engineering Β· Apr 2016 – Jul 2018
    High-throughput financial aggregation platform at 10M+ transactions/day (Java Spring Boot + Apache Kafka); framework-agnostic integration bridging 100+ heterogeneous bank APIs into a unified runtime; OAuth 2.0 client framework for PSD2-compliant EU Open Banking.
  • ARM Embedded Technologies β€” Software Engineer, Build & Automation Tooling Β· Jan 2012 – Apr 2016
    Automation tooling for Physical IP modeling & validation β€” reduced manual verification effort ~60% and established build patterns reused across R&D teams.

πŸŽ“ B.E., Electronics & Communications Engineering β€” Osmania University, Hyderabad, India (2007 – 2011)

🧰 Tech & Tools

Not a logo wall β€” here's the stack I build with, and the role each piece plays in my work.

πŸ€– AI & Agentic Systems

Stack How I apply it
MCP First-class context & tool interface so agents and 3rd-party tools interoperate without bespoke glue
A2A Protocol for inter-agent communication and coordination across the multi-agent runtime
Orchestration Distributed runtime β€” turn-taking, context propagation & human-in-the-loop control at 300M+ DAU scale
RAG Grounds LLM responses in live, domain-specific context for accuracy and trust
Eval Golden-set regression eval, telemetry-driven quality gates & distributed tracing β€” the contract that lets models change without product regression
Azure OpenAI Claude OpenAI AutoGen Foundation models behind a thin, provider-agnostic layer β€” swap providers, route by task complexity, unify telemetry

πŸ—οΈ Distributed Systems & Platform

Stack How I apply it
Event-Driven Decoupled, asynchronous coordination β€” the backbone for resilience and elastic scale
Microservices Independently deployable services with clear ownership and contained blast radius
Resilience Partial-failure isolation and idempotent retries designed in as defaults, not afterthoughts
Scale Stateless scale-out patterns proven at hundreds of millions of users
SDK Developer-facing SDKs, API governance, and onboarding that make the right thing the easy thing

πŸ’» Languages

Stack How I apply it
Python Agentic systems, LLM orchestration, eval harnesses, and AI tooling
C# High-throughput Teams platform services
Java Built event-driven financial-aggregation APIs handling 10M+ transactions/day
TypeScript JavaScript Type-safe full-stack development across UI and services
Node.js SQL Lightweight API/tooling runtime and relational data access

🎨 Frontend

Stack How I apply it
React Component architecture for cloud-native collaborative platforms (Project Online)
Fluent UI Optimized the Data Grid rendering pipeline for a 30% page-load reduction
GraphQL Typed, efficient client–server data contracts

☁️ Cloud · Data · Messaging

Stack How I apply it
Azure Primary cloud β€” Service Bus, Functions, Cosmos DB, and Azure OpenAI
Kafka Service Bus High-throughput event streaming and reliable enterprise messaging
Docker Containerized, reproducible packaging for every service
Cosmos DB MongoDB MySQL Oracle Document and relational stores chosen to fit the access pattern

πŸ“ˆ GitHub

Raju's GitHub stats Top languages


High availability, fault-tolerance & horizontal scalability β€” as first principles.

Pinned Loading

  1. chatgpt-meeting-summary chatgpt-meeting-summary Public

    TypeScript