Lead Data Engineer

As a Lead Data Engineer in Chennai with a focus on Data Platform and Big Data, your role involves building the foundation of AI by engineering data systems that drive enterprise intelligence. You should have at least 5 years of experience in Data Engineering and possess the ability to design scalable and reliable data platforms that facilitate intelligent business decisions. Key Responsibilities: - Design and build scalable data pipelines and data lake architectures for high-performance analytics. - Develop robust data ingestion, transformation, and processing systems from raw data to production-ready datasets. - Architect and deploy data solutions on cloud platforms such as AWS, Azure, or GCP with strong DevOps and automation practices. - Work with distributed data processing frameworks like Spark, Hadoop, and Hive to handle large-scale data workloads. - Partner with cross-functional teams to deliver reliable and impactful data solutions. - Ensure data quality, governance, security, and performance through standardization and continuous improvement. Qualifications Required: - Strong experience in data engineering with proficiency in Python, Scala, or Java. - Hands-on expertise in building scalable data pipelines and distributed systems. - Good understanding of data lake architecture, data warehousing, and relational databases (Oracle, SQL, DB2, Teradata). - Experience with Big Data technologies such as Hadoop, Spark, Hive, and HBase. - Experience with cloud platforms (AWS, Azure, or GCP). As a Lead Data Engineer, you will lead and deliver data engineering and analytics projects that have a direct business impact. You will be responsible for building and optimizing data pipelines and infrastructure for scalability and efficiency. Additionally, you will play a key role in communicating complex data concepts to technical and business stakeholders, driving data strategy, supporting analytics-driven decision-making, and designing data-driven features for product platforms. Travel to client locations may be required as part of the role. As a Lead Data Engineer in Chennai with a focus on Data Platform and Big Data, your role involves building the foundation of AI by engineering data systems that drive enterprise intelligence. You should have at least 5 years of experience in Data Engineering and possess the ability to design scalable and reliable data platforms that facilitate intelligent business decisions. Key Responsibilities: - Design and build scalable data pipelines and data lake architectures for high-performance analytics. - Develop robust data ingestion, transformation, and processing systems from raw data to production-ready datasets. - Architect and deploy data solutions on cloud platforms such as AWS, Azure, or GCP with strong DevOps and automation practices. - Work with distributed data processing frameworks like Spark, Hadoop, and Hive to handle large-scale data workloads. - Partner with cross-functional teams to deliver reliable and impactful data solutions. - Ensure data quality, governance, security, and performance through standardization and continuous improvement. Qualifications Required: - Strong experience in data engineering with proficiency in Python, Scala, or Java. - Hands-on expertise in building scalable data pipelines and distributed systems. - Good understanding of data lake architecture, data warehousing, and relational databases (Oracle, SQL, DB2, Teradata). - Experience with Big Data technologies such as Hadoop, Spark, Hive, and HBase. - Experience with cloud platforms (AWS, Azure, or GCP). As a Lead Data Engineer, you will lead and deliver data engineering and analytics projects that have a direct business impact. You will be responsible for building and optimizing data pipelines and infrastructure for scalability and efficiency. Additionally, you will play a key role in communicating complex data concepts to technical and business stakeholders, driving data strategy, supporting analytics-driven decision-making, and designing data-driven features for product platforms. Travel to client locations may be required as part of the role.