Senior Big Data Engineer-I

As a Data Engineer at MetLife's Global capability center in Hyderabad, Telangana, you will play a critical role in the data and analytics life cycle, contributing significantly to the production-grade data and analytics solutions. Your responsibilities will include: - Designing, building, and maintaining robust ETL/ELT pipelines on cloud (Azure) or on-premises to collect, ingest, and store large volumes of structured and unstructured data for batch/real-time processing. - Monitoring, optimizing, and troubleshooting data pipelines to ensure reliability, scalability, and performance. - Ensuring adherence to data processing, quality, security, and compliance guidelines, policies, and standards. - Collaborating with multiple partners from Business, Technology, Operations, and D&A capabilities such as Data Governance, Data Quality, Data Modeling, Data Architecture, Data Science, DevOps, BI & insights. - Mentoring Data Engineers and independently leading design, solutioning & estimations. Technical Skills required for this role include: - SQL, Python/Scala - NoSQL and distributed databases (HBase, Cosmos DB) - ETL pipeline design and development; Solutioning and estimation - Big Data Frameworks: Apache Spark, Hadoop, Hive - Cloud platforms: Azure data factory, EventHub, Azure functions, Synapse, Databricks - Data warehouses, data marts, data lakes - Medallion architecture - Performance tuning, optimization, and data quality validation - Real-time and batch data processing, streaming pipelines with Spark - Communication skills, analytical skills, structured problem-solving skills, mentorship skills Additional qualifications required for this role: - 8-10+ years of relevant experience - Bachelor's degree in computer science, information technology, or equivalent educational qualification Good to have skills include: - DevOps practices: Git, Azure DevOps, CI/CD pipelines - Unix shell scripting, Kafka, MongoDB, Nifi - Exposure to Gen AI technology and tools - Banking Financial Services and Insurance domain knowledge MetLife is recognized as one of the "World's Most Admired Companies" and Fortune Worlds 25 Best Workplaces. With operations in more than 40 markets, MetLife aims to help colleagues, customers, communities, and the world create a more confident future. Guided by core values such as Win Together, Do the Right Thing, and Think Ahead, MetLife is committed to transforming the next century in financial services. Join MetLife and be a part of their purpose-driven journey. As a Data Engineer at MetLife's Global capability center in Hyderabad, Telangana, you will play a critical role in the data and analytics life cycle, contributing significantly to the production-grade data and analytics solutions. Your responsibilities will include: - Designing, building, and maintaining robust ETL/ELT pipelines on cloud (Azure) or on-premises to collect, ingest, and store large volumes of structured and unstructured data for batch/real-time processing. - Monitoring, optimizing, and troubleshooting data pipelines to ensure reliability, scalability, and performance. - Ensuring adherence to data processing, quality, security, and compliance guidelines, policies, and standards. - Collaborating with multiple partners from Business, Technology, Operations, and D&A capabilities such as Data Governance, Data Quality, Data Modeling, Data Architecture, Data Science, DevOps, BI & insights. - Mentoring Data Engineers and independently leading design, solutioning & estimations. Technical Skills required for this role include: - SQL, Python/Scala - NoSQL and distributed databases (HBase, Cosmos DB) - ETL pipeline design and development; Solutioning and estimation - Big Data Frameworks: Apache Spark, Hadoop, Hive - Cloud platforms: Azure data factory, EventHub, Azure functions, Synapse, Databricks - Data warehouses, data marts, data lakes - Medallion architecture - Performance tuning, optimization, and data quality validation - Real-time and batch data processing, streaming pipelines with Spark - Communication skills, analytical skills, structured problem-solving skills, mentorship skills Additional qualifications required for this role: - 8-10+ years of relevant experience - Bachelor's degree in computer science, information technology, or equivalent educational qualification Good to have skills include: - DevOps practices: Git, Azure DevOps, CI/CD pipelines - Unix shell scripting, Kafka, MongoDB, Nifi - Exposure to Gen AI technology and tools - Banking Financial Services and Insurance domain knowledge MetLife is recognized as one of the "World's Most Admired Companies" and Fortune Worlds 25 Best Workplaces. With operations in more than 40 markets, MetLife aims to help colleagues, customers, communities, and the world create a more confident future. Guided by core values such as Win Together, Do the Right Thing, and Think Ahead, MetLife is committed to transforming the next century in financial services. Join MetLife and be a