Principal Data Engineer

We are seeking a highly experienced Principal Data Engineer / Senior Data Architect to lead the design, architecture, and scalability of modern data platforms. This role requires deep expertise in building enterprise-grade data ecosystems across cloud, real-time, batch, governance, and AI-ready infrastructure. You will own the end-to-end data architecture vision from ingestion and transformation to analytics, ML enablement, governance, and cost optimisation. The Candidate Will Have Responsibilities Across The Following Functions Data Architecture and Platform Design: Architect scalable data lakehouse and warehouse platforms Define canonical data models and domain-driven data architecture Design medallion (Bronze/Silver/Gold) architectures Establish data standards, governance, and security frameworks Evaluate and select cloud-native data tools Engineering And Implementation Leadership Build high-performance ETL/ELT pipelines (batch + streaming) Architect real-time data pipelines using event-driven systems Optimise large-scale distributed data processing systems Implement CI/CD for data engineering workflows Ensure reliability, scalability, and observability Cloud And Modern Data Stack Expertise Hands-on experience with Amazon Web Services, Microsoft Azure, or Google Cloud Strong expertise in Databricks, Snowflake, Apache Kafka, and Airflow. Analytics And AI Enablement Design data platforms optimised for BI and AI workloads Enable feature stores and ML-ready datasets Support GenAI and advanced analytics use cases Ensure high data quality and lineage tracking Governance, Security And Cost Optimisation Implement RBAC, encryption, and data masking Design cost-aware architectures Monitor usage and optimise cloud spend Define data SLAs and reliability frameworks. Leadership And Strategy Lead and mentor data engineering teams Conduct architecture reviews Partner with product, AI, and business teams Define long-term data strategy and roadmap Drive technical excellence and coding standards. Requirements 8+ years of experience in data engineering/data architecture. Proven experience designing large-scale data platforms. Deep expertise in distributed systems. Strong SQL and Python/Scala skills. Experience handling TB-PB scale datasets. Strong understanding of data modelling (dimensional + data vault). Experience with real-time and streaming architecture. Experience leading technical teams. Experience in FinTech, SaaS, or enterprise consulting. Experience building data engineering practice from scratch. Exposure to AI/ML infrastructure. Certifications in AWS/Azure/GCP. Experience with multi-cloud environments. This job was posted by Eucloid Careers from Eucloid Data Solutions.