Available for Staff / Principal opportunities

Hi, I'm Rahul Pandey.

Staff Software Engineer at Cisco ThousandEyes — I design petabyte-scale, low-latency distributed systems and AI-augmented observability platforms that serve 10K+ enterprise accounts.

Currently leading the Events platform — Apache Flink + Kafka pipelines, ML-driven correlation, and GenAI summarization on AWS Bedrock.

Get in touch See my work
Rahul Pandey Apache Flink AWS Bedrock Kafka Java · Python
0
Years of experience
0
Datapoints processed
0
Enterprise accounts served
0
Global OCI regions launched

01 · About

Engineer · Architect · Mentor

I'm a Staff Software Engineer with over a decade of experience designing the kind of systems that hum quietly in the background while millions of events fly through them — distributed stream processors, low-latency APIs, and the data platforms that power modern observability.

At Cisco ThousandEyes, I lead the Events platform: a unified detection pipeline on Apache Flink + Kafka that consolidates Cloud Agents, Endpoint Agents, and Connected Devices into one engine — 10M+ datapoints/sec with 40% lower detection latency. I was promoted to Staff in early 2025 for sustained cross-org technical leadership and end-to-end delivery of company-priority initiatives.

These days I spend a lot of time on the intersection of distributed systems and AI — productionizing GenAI summarization on AWS Bedrock (Claude Sonnet 4.5), integrating DBSCAN-based ML clustering for incident correlation, and building anomaly detection that's shared across multiple product lines.

Outside of work I read voraciously (tech and otherwise), follow ML research, and unwind with video games.

Currently focused on

  • Real-time stream processing at scale (Flink + Kafka)
  • LLM-powered automation & event summarization
  • Event correlation & anomaly detection (DBSCAN, statistical)
  • Cross-org architecture, RFCs, and mentorship

Based in

Newark, CA · USA

Speaks

English, Hindi

02 · Experience

A decade of building.

  1. Senior Software Engineer II · Staff

    Jan 2025 — Present

    Cisco ThousandEyes · Events Team · USA

    • Architected the Unified Event Detection Pipeline on Flink + Kafka — consolidating Cloud Agents, Endpoint Agents, and Connected Devices into one platform at 10M+ datapoints/sec (EPA) and 2M+ (CEA); cut end-to-end detection latency by 40%.
    • Shipped the Event Correlation Engine — integrated a DBSCAN ML clustering microservice (Python sidecar) into the Flink topology with the ML/Research org; materially reduced redundant alerts.
    • Productionized GenAI Event Summarization on AWS Bedrock (Claude Sonnet 4.5) — translating raw correlated signals into customer-readable incident narratives and runbooks.
    • Delivered the Flink-based Alerter Engine serving 10K+ accounts at ~1,000 notifications / 5-min window; led the legacy migration with zero regressions.
    • Built the shared Anomaly Detection Service for HTTP, latency, RTT, and jitter — now expanding across multiple ThousandEyes product lines.
    JavaPythonSpring BootApache FlinkKafkaDynamoDBKubernetesAWSTerraformLLMs

  2. Senior Software Engineer

    Apr 2023 — Dec 2024

    Cisco ThousandEyes · USA

    • Led the design of a BGP data processing pipeline — chunking, alert generation, DB updates, route optimization — with C++ gRPC services and cron-based health monitoring.
    • Implemented Debezium-based change data capture integrated with Kafka and SQL stores for reliable, real-time replication.
    • Owned DynamoDB schema & infra redesign for low-latency, large-scale access supporting AI-driven observability use cases.
    JavaC++PythongRPCKafkaFlinkProtobufKubernetesElasticsearchAWS

  3. Senior Member of Technical Staff

    Aug 2021 — Apr 2023

    Oracle Americas · USA

    • Core contributor to the fully-managed OpenSearch service on OCI — 30+ regions globally; owned design and delivery of multiple components.
    • Automated cluster provisioning, backup, and patching — cut provisioning time by ~50% and removed recurring operational toil.
    • Authored synthetic canaries and on-call alerting; mentored junior engineers and supported critical customer incidents.
    JavaPythonKubernetesDockerElasticsearchTerraformOCIOKE

  4. Full-Stack Engineer

    Jan 2021 — Jul 2021

    Verisk · PowerAdvocate · USA

    • Built Python (Flask/Dash) data-science apps and Apache Airflow pipelines on AWS EKS.
    PythonFlaskDashRedisMemSQLPandasAWSRedshift

  5. Software Engineer Intern

    May 2020 — Aug 2020

    Cambridge Semantics · Boston, USA

    • Built Spark/Scala semantic services on GCP/GKE for the ANZO platform; shipped the Concept-Linkage feature that reduced manual user effort by ~75%.
    Java 8ScalaApache SparkKnowledge GraphsRDFSPARQLGKE

  6. Software Engineer III → I

    Aug 2015 — Aug 2019

    SAP Labs Private Limited · Bengaluru, India

    • Architected multi-tenant SaaS Java microservices on Cloud Foundry exposing OAuth 2.0 SAML-bearer-secured REST APIs powering SAP marketing products.
    • Authored a SOLID-driven Maven library (Factory, Singleton, Builder, DI) adopted across marketing services for fault tolerance, multi-tenancy, and HMAC validation.
    Java 8Node.jsAngular.jsSpring CloudODataCloud FoundrySAP HANA

03 · Skills

Tools of the trade.

{ }

Languages

JavaPythonGoScalaJavaScriptC / C++BashHTML / CSS
≋

Streaming & Data

Apache FlinkApache KafkaApache SparkDebeziumgRPCProtobufAirflow
✦

AI / ML

AWS BedrockClaude SonnetLLMsDBSCANAnomaly DetectionTensorFlowPyTorch
☁

Cloud & Infra

AWSOCIGCPAzureKubernetesDockerTerraformEKS · OKE · GKE
⛁

Databases

DynamoDBElasticsearch / OpenSearchMongoDBMySQLRedshiftMemSQLSAP HANARedis
⚙

Frameworks

Spring BootSpring MVCFlaskDashNode.jsReact.jsExpress

04 · Featured Work

Things I've shipped.

Unified Event Detection Pipeline

Apache Flink + Kafka pipeline consolidating 3 ingestion sources into a single platform — sustaining 10M+ datapoints/sec, 40% lower detection latency, zero duplicate-incident noise.

FlinkKafkaJavaAWS

Event Correlation Engine

DBSCAN-based ML clustering microservice (Python sidecar) integrated into the Flink topology — suppressing redundant alerts and improving incident quality for thousands of customers.

PythonDBSCANFlinkML

GenAI Event Summarization

Productionized on AWS Bedrock with Claude Sonnet 4.5 — converting raw correlated signals into customer-readable narratives and runbooks. Cut on-call cognitive load and triage time.

AWS BedrockClaudeLLMsJava

Anomaly Detection Service

Shared service for HTTP, latency, RTT, and jitter signals — improving detection accuracy and reducing false positives. Expanding across multiple ThousandEyes product lines.

PythonStatisticsFlinkJava

Managed OpenSearch on OCI

Core contributor to Oracle's fully-managed Elasticsearch service across 30+ regions globally — automated cluster provisioning, backup, and patching workflows that cut provisioning time by ~50%.

JavaKubernetesOCITerraform

EasyEvent — side project

Full-stack MERN + GraphQL app for creating and booking events. Used Facebook's DataLoader to batch and cache API calls per event-loop cycle, reducing DB reads.

GraphQLMongoDBExpressReactNode.js

05 · Education

Where I learned.

2019 — 2021

Northeastern University

Khoury College of Computer Sciences · Boston, MA

Master of Science in Computer Science

GPA: 3.9 / 4.0

Programming Design Paradigms · Algorithms · Foundations of AI · Large-Scale Parallel Data Processing · Building Scalable Distributed Systems · DBMS

2011 — 2015

SGSITS

Shri Govindram Seksaria Institute of Technology and Science · Indore, India

Bachelor of Engineering in Computer Engineering

OOP · Data Structures · Databases · Software Engineering · Cloud Computing

Certifications

Version Control with Git Kubernetes: Microservices Kubernetes: Cloud-Native Ecosystem Learning Kubernetes Machine Learning A–Z Operations with SAP Cloud Platform

06 · Contact

Let's build something great.

Always open to thoughtful conversations — distributed systems, AI platforms, mentorship, or just a good engineering story.

rahul.office800@gmail.com View Resume

Email

rahul.office800@gmail.com

Location

Newark, CA · USA

Find me on