Padmi

Principal Data Engineer

ChennaiPosted 3 months ago
Infrastructure And DatabasesStaff+Full Time; Regular
Apply at AVTAR Career Creators

Opens the source posting on shine.com

Source description

About the role

View original

As a Principal Data Engineer at this reputed organization based in Chennai, you will be responsible for the following: - Expertise in building cloud-based data ecosystems across batch, real-time, analytics, governance, and AI-ready infrastructure. - Strong experience in architecting scalable data lakehouse and data warehouse solutions. - Hands-on expertise in ETL/ELT pipelines, streaming architecture, and distributed data processing systems. - Strong knowledge of canonical data models, medallion architecture (Bronze/Silver/Gold), and data governance frameworks. - Proficient in SQL, Python, and/or Scala with experience handling TBPB scale datasets. - Experience with cloud platforms like AWS, Azure, or GCP and modern tools such as Databricks, Snowflake, Kafka, and Airflow. - Ability to design BI- and AI-ready platforms, including ML datasets, feature stores, and GenAI use cases. - Expertise in implementing security, RBAC, encryption, lineage tracking, and data quality frameworks. - Strong focus on scalability, observability, reliability, and cloud cost optimization. - Proven experience leading data engineering teams, driving architecture reviews, and defining long-term data strategy. Desired Candidates Profile: - 8+ years of experience in Data Engineering and Data Architecture. - Strong experience in designing and building large-scale data platforms. Please note: This job opportunity offers you a chance to work with cutting-edge technologies and be a part of a dynamic team that values innovation and excellence in data engineering practices. As a Principal Data Engineer at this reputed organization based in Chennai, you will be responsible for the following: - Expertise in building cloud-based data ecosystems across batch, real-time, analytics, governance, and AI-ready infrastructure. - Strong experience in architecting scalable data lakehouse and data warehouse solutions. - Hands-on expertise in ETL/ELT pipelines, streaming architecture, and distributed data processing systems. - Strong knowledge of canonical data models, medallion architecture (Bronze/Silver/Gold), and data governance frameworks. - Proficient in SQL, Python, and/or Scala with experience handling TBPB scale datasets. - Experience with cloud platforms like AWS, Azure, or GCP and modern tools such as Databricks, Snowflake, Kafka, and Airflow. - Ability to design BI- and AI-ready platforms, including ML datasets, feature stores, and GenAI use cases. - Expertise in implementing security, RBAC, encryption, lineage tracking, and data quality frameworks. - Strong focus on scalability, observability, reliability, and cloud cost optimization. - Proven experience leading data engineering teams, driving architecture reviews, and defining long-term data strategy. Desired Candidates Profile: - 8+ years of experience in Data Engineering and Data Architecture. - Strong experience in designing and building large-scale data platforms. Please note: This job opportunity offers you a chance to work with cutting-edge technologies and be a part of a dynamic team that values innovation and excellence in data engineering practices.

One address, no account. We’ll tell you when matching roles go live.