Career Journey

Experience

Building scalable data systems with measurable impact across 7+ years of production experience.

Fintech Platform

2023 - PresentRemote

▸Built Kafka → PySpark real-time credit decisioning pipeline processing 100K+ applications/day
▸Reduced decisioning latency from 48 hours batch to under 2 minutes streaming
▸Engineered 200+ credit risk features computed in-flight with 95%+ model accuracy
▸Implemented exactly-once delivery semantics with watermark-based late-event handling
▸Designed A/B testing framework for safe model deployment with automatic rollback

KafkaPySparkSpark Structured StreamingPostgreSQLAWSMLflowRedis

Enterprise Data Platform

2022 - 2023Remote

▸Unified 50+ isolated AWS Glue jobs into Databricks medallion lakehouse (Bronze/Silver/Gold)
▸Achieved 60% pipeline runtime reduction with Delta Lake and Photon engine
▸Implemented Unity Catalog for governance across 8 engineering teams with zero schema conflicts
▸Built dbt schema contracts and Great Expectations quality gates at Silver layer
▸Established automated data lineage tracking and cost attribution framework

DatabricksDelta LakePySparkUnity CatalogdbtAWS GlueGreat Expectations

Cloud Migration Programme

2020 - 2022Hybrid

▸Led 100TB migration from on-premise Oracle + AWS Redshift to Snowflake + BigQuery
▸Achieved 70% query performance improvement (p95: 42s → 11s) and 40% cost reduction
▸Implemented dual-write validation strategy enabling zero-downtime cutover
▸Re-modeled physical layer with micro-partition clustering and incremental ELT via dbt
▸Established automated data validation framework ensuring consistency during migration

SnowflakeBigQuerydbtAirflowAirbytePythonOracleRedshift

Available Now

Open to solving complex data engineering challenges and building systems that don't break at scale.

Typically respond within 24 hours