STAFF DATA & PLATFORM ENGINEER

Systems that scale.
Built with intention.

I’m Rohan. I turn complex data problems into reliable platforms, thoughtful infrastructure, and systems that earn trust in production.

Currently building enterprise data platforms
at Flutter Entertainment.

THE SYSTEMS MINDSET

Reliable from the first event. Durable ingestion, clear contracts, and backpressure by design.

8+ YEARS OF BUILDINGSTREAMING & DISTRIBUTED SYSTEMSENGINEER. CONTRIBUTOR. EXPLORER.SCROLL TO EXPLORE

01 / SELECTED WORK

Big ideas.
Working implementations.

My systems notebook, in code. Focused projects exploring how data moves, how engines execute, and where performance comes from.

02 / EXPERIENCE

A career in
making things work.

From healthcare data to real-time platforms and enterprise infrastructure. Eight years of learning what production actually demands.

Flutter EntertainmentCurrentStaff Data Engineer, Enterprise TechJun 2026 - Present
  • Working across enterprise data and platform initiatives with a focus on reliable architecture, clear ownership, and scalable delivery.
  • Bringing production discipline from streaming systems into broader data workflows, platform patterns, and technical direction.
Enterprise Tech Data Platforms AWS Platform Engineering Streaming Systems
PokerStarsLead Big Data Engineer, Streaming AIJan 2026 - Jun 2026
  • Promoted to lead the Streaming AI data engineering track, guiding architecture and delivery for real-time workloads on AWS.
  • Continued optimization of hot-path IO, storage layout, and state handling to improve runtime behavior and infrastructure efficiency.
  • Strengthened production readiness through exactly-once sinks, checkpoint strategy, and recovery tuning across Flink-based services.
Java Python Go Flink Spark Kafka / MSK Kinesis Data Analytics DynamoDB Apache Iceberg S3 AWS Airflow
PokerStarsSenior Big Data Engineer, Streaming AIAug 2023 - Jan 2026
  • Designed real-time processing on AWS using Flink on Kinesis Data Analytics, MSK, DynamoDB, and S3 for high-value production workloads.
  • Reduced hot-path IO and delivered major annual cost savings through DynamoDB modeling, payload compaction, and S3 layout tuning.
  • Built exactly-once sinks with checkpoint alignment and idempotent upserts while tuning RocksDB state and JVM behavior for recovery and latency.
Java Python Go Flink Spark Kafka / MSK Kinesis Data Analytics DynamoDB Apache Iceberg S3 AWS Airflow
Experian PLCSenior Data EngineerMar 2023 - Aug 2023
  • Delivered regulated pipelines with secure ingestion, lineage, and data quality gates to improve analytics readiness and operational trust.
  • Standardized batch and streaming jobs with reproducible configuration, deployment discipline, and monitoring that reduced delivery friction.
Java Scala Python Go Spark Flink Kafka PostgreSQL Kubernetes Prometheus Apache Iceberg Grafana Data Quality Airflow
Model NMember of Technical Staff 3Jun 2021 - Mar 2023
  • Built event-driven analytics with Kafka, Spark, and Delta Lake and exposed downstream access through Dremio and REST services.
  • Improved query performance with partitioning, Z-ordering, predicate pushdown, and compaction to lower compute and storage cost.
Spark Flink Java Python Scala Kafka Delta Lake Dremio Apache Iceberg REST APIs Spring Boot Cost Optimization Airflow Kubernetes
Carelon Global SolutionsSoftware EngineerAug 2020 - Jun 2021
  • Integrated Medicare and Medicaid datasets with SQL and distributed data processing to improve revenue capture and reporting readiness.
  • Supported analytics workflows with reliable pipeline behavior across Spark, Flink, Kafka, PostgreSQL, and AWS services.
Spark Flink Java Python SQL Kafka PostgreSQL AWS Apache Iceberg Delta Lake Airflow
Legato Health TechnologiesAssociate Software EngineerJul 2018 - Aug 2020
  • Delivered optimized ETL on Teradata and Informatica while standardizing SLAs, validations, and delivery quality for healthcare data workflows.
  • Built a strong foundation in enterprise data movement, operational rigor, and quality-minded delivery.
Spark Teradata Python Java Kafka Informatica Apache Iceberg ETL Delta Lake Airflow

From the first pipeline to the platform behind it.

The full story, in my résumé

03 / HOW I THINK

Good infrastructure
earns trust quietly.

I work at the intersection of distributed systems, real-time data, and performance engineering. The runtime details are where the interesting work begins.

Explore my toolkit
01

Understandable by design.

Architecture should make the next decision easier. Clear ownership, simple interfaces, and operational behavior a team can reason about.

02

Correct before clever.

Event time, state, checkpoints, and recovery are first-class concerns. Reliability starts with the semantics, long before the incident.

03

Fast for the right reasons.

Follow the bytes. Measure real workloads. Improve storage layout, hot-path I/O, and runtime behavior before adding more infrastructure.

FOUNDATIONS

B.Tech, Electrical EngineeringJawaharlal Nehru Technological University, Hyderabad

2014 — 2018

THE TOOLKIT

Depth across the data path.

Different tools. The same focus on correctness, performance, and the people operating the system.

01

Languages

Rust · Go · Java · Python · Scala · C++ · SQL · Shell

02

Streaming & compute

Flink · Kafka / MSK · Spark · Pulsar · Kinesis · Airflow

03

Storage & infrastructure

Iceberg · Delta Lake · Hudi · Arrow · Parquet · DynamoDB · S3 · PostgreSQL · Kubernetes · Docker

04

Query & analytics

DataFusion · Trino · Presto · ClickHouse · Dremio · DuckDB

04 / OPEN SOURCE

Learn in public.
Leave something useful.

I read implementations, test ideas against real workloads, and contribute fixes and improvements. Open source turns that curiosity into something others can build on.

Explore my contributions
01 Profile snapshot
Rohan Dubey’s GitHub statistics
02 Language mix
Most used languages across Rohan’s repositories
03 Contribution streak
Total contributions, current streak, and longest streak
Daily GitHub contributions over the last 31 days
BUILT IN THE OPEN. UPDATED DAILY.All repositories

GOOD WORK STARTS WITH A CONVERSATION

Let’s build something
that lasts.

Streaming platforms, query engines, open source,
or a difficult systems problem. I’d love to hear about it.

Say hello