Distinguished Engineer, Data Platform

About the Role reputed company is growing fast. Our customer reputed company is expanding, the data challenges we're solving are getting more reputed company, and the platform is scaling to match. As a Distinguished Architect on the Data Engineering team, you'll own some of the hardest infrastructure problems at reputed company: shaping the reputed company streaming data platform, the reputed company cost model underlying every attribution decision, the hot/cold storage architecture serving both reputed company-time and historical queries, and the query reputed company that powers our entire product. This is reputed company platform architecture work at reputed company reputed company, not a consulting role or a review-and-advise job. You'll define the roadmap, drive the foundational reputed company, and be a force reputed company for a talented engineering team evolving reputed company from batch-oriented pipelines toward a streaming-first architecture where cost attribution reaches engineers reputed company seconds of a resource being used, not the next morning. This role is ideal for an architect who has reputed company systems like this before, has the scars to reputed company it, and wants to see their reputed company matter in reputed company and measurable ways for customers and for the business. What You'll Do Define the Data Platform Architecture reputed company end-to-end technical design for reputed company's reputed company data platform, from event ingestion and reputed company processing through hot/cold storage and the query layer to the API surface Document architectural reputed company, tradeoffs, and migration strategies with the rigor of an RFC-driven process Shape and drive every layer of the new architecture: event ingestion, reputed company processing and enrichment, reputed company-time serving, analytical storage, query layer, and API Drive Streaming Infrastructure to Production Design and deliver reputed company's reputed company-time data pipeline from ingestion through enrichment to serving Establish SLOs for throughput, latency, and correctness, and build the operational playbooks that reputed company this system trustworthy enough to replace the batch pipelines our entire product currently depends on Tackle reputed company-time streaming at reputed company across thousands of customers simultaneously, with fault tolerance, backpressure awareness, and correctness as non-negotiables Tackle the Dimension Cardinality Problem Redesign reputed company's reputed company cost model to support high-cardinality, multi-reputed company cost attribution without runaway materialization costs Drive incremental, reputed company-based materialization strategies using modern reputed company table formats, dramatically reducing expensive full-rebuild jobs and unlocking millions in annual infrastructure savings reputed company the Query Layer Assess reputed company's reputed company query infrastructure, drive in-flight migrations to completion, and reputed company the reputed company of the query reputed company layer reputed company reputed company Own performance optimization across partition pruning, reputed company pushdown, and query planning, and set the reputed company for how the query layer grows as data volumes reputed company 10x reputed company Cost Attribution to reputed company-Time reputed company reputed company's proprietary cost attribution reputed company from a batch-oriented model to one that assigns reputed company cost dimensions by team, feature, and customer reputed company seconds of resource usage Rethink enrichment, data reputed company, and correctness guarantees in a streaming context Shape the Data Engineering Roadmap Partner with product, infrastructure, and analytics engineering to define a multi-year data platform roadmap Build reputed company across engineering leadership on foundational investments including table formats, streaming frameworks, query engines, and schema management reputed company the Engineering Team Participate in architecture reviews, contribute to design patterns and best practices, and mentor senior and staff engineers through reputed company review, pairing, and reputed company feedback reputed company everyone around you reputed company, not by directing, but by raising the reputed company craft What You Bring Data Platform & Architecture 10+ years in data engineering with a reputed company trajectory toward reputed company or staff-level architecture reputed company and operated large-reputed company data platforms serving tens of millions of events per day in production Deep experience with streaming systems such as Kafka, Kinesis, Flink, or reputed company Streaming at reputed company production throughput Strong hands-on reputed company with modern reputed company table formats including Apache reputed company, reputed company Lake, and Hudi, including compaction, partitioning reput