Data Engineering Analyst

As a part of the Optum global organization, you will play a crucial role in improving health outcomes by connecting individuals with necessary care, pharmacy benefits, and resources. The company culture emphasizes inclusion, offers comprehensive benefits, and provides opportunities for career development, allowing you to make a significant impact on communities worldwide. Primary Responsibilities: - Contribute hands-on to the design, ETL development, and operation of cloud-native data pipelines on Azure and Databricks - Design and optimize Spark-based ETL frameworks for large-scale batch and incremental processing - Implement complex transformations and performance tuning using Python and Spark SQL - Modernize on-prem ETL workloads to Databricks/snowflake, ensuring enterprise standards for scalability, reliability, and governance - Collaborate with cross-functional teams to understand complex data requirements and deliver tailored solutions - Ensure data quality and integrity by implementing robust data validation and monitoring processes - Develop comprehensive documentation for data engineering processes and systems You will be required to comply with the terms and conditions of the employment contract, company policies, and procedures, as well as any directives related to changes in work locations, teams, or work shifts. Required Qualifications: - Bachelor's degree (B.E./B.Tech) in any engineering or related discipline - Hands-on experience with Databricks and cloud-native data platforms, preferably on Azure - Solid experience building ETL pipelines using Python, PySpark, and Spark SQL - Experience with ETL tools (e.g., DataStage) and large-scale data warehouse implementations - Familiarity with cloud ecosystems (Azure/AWS/GCP) and workflow orchestration tools like Airflow - Proven analytical and problem-solving skills with the ability to deliver scalable, reliable data solutions - Proficiency in SQL and working with relational and distributed database systems At UnitedHealth Group, the mission is to help people live healthier lives and improve the health system for everyone. The company is committed to addressing health disparities and improving health outcomes for all individuals, regardless of race, gender, sexuality, age, location, or income level. As a part of the Optum global organization, you will play a crucial role in improving health outcomes by connecting individuals with necessary care, pharmacy benefits, and resources. The company culture emphasizes inclusion, offers comprehensive benefits, and provides opportunities for career development, allowing you to make a significant impact on communities worldwide. Primary Responsibilities: - Contribute hands-on to the design, ETL development, and operation of cloud-native data pipelines on Azure and Databricks - Design and optimize Spark-based ETL frameworks for large-scale batch and incremental processing - Implement complex transformations and performance tuning using Python and Spark SQL - Modernize on-prem ETL workloads to Databricks/snowflake, ensuring enterprise standards for scalability, reliability, and governance - Collaborate with cross-functional teams to understand complex data requirements and deliver tailored solutions - Ensure data quality and integrity by implementing robust data validation and monitoring processes - Develop comprehensive documentation for data engineering processes and systems You will be required to comply with the terms and conditions of the employment contract, company policies, and procedures, as well as any directives related to changes in work locations, teams, or work shifts. Required Qualifications: - Bachelor's degree (B.E./B.Tech) in any engineering or related discipline - Hands-on experience with Databricks and cloud-native data platforms, preferably on Azure - Solid experience building ETL pipelines using Python, PySpark, and Spark SQL - Experience with ETL tools (e.g., DataStage) and large-scale data warehouse implementations - Familiarity with cloud ecosystems (Azure/AWS/GCP) and workflow orchestration tools like Airflow - Proven analytical and problem-solving skills with the ability to deliver scalable, reliable data solutions - Proficiency in SQL and working with relational and distributed database systems At UnitedHealth Group, the mission is to help people live healthier lives and improve the health system for everyone. The company is committed to addressing health disparities and improving health outcomes for all individuals, regardless of race, gender, sexuality, age, location, or income level.