Senior Data Engineering Consultant

As a Data Engineer at Optum, you will play a crucial role in architecting all phases of software engineering, focusing on business intelligence dataset development. Your responsibilities will include: - Supporting the full data engineering lifecycle by researching, designing, developing, testing, and maintaining end-to-end data processing systems and data management solutions. - Designing reusable components, frameworks, and libraries to enhance efficiency. - Contributing to the design and architecture to ensure secure, scalable, and maintainable solutions. - Collaborating with People Analytics to develop standard datasets for actionable decision-making. - Designing, building, and maintaining scalable data pipelines to process large volumes of data from various sources. - Integrating data from multiple sources while ensuring data quality and consistency. - Developing and managing databases, data warehouses, and data lakes for efficient data storage. - Utilizing data quality tools to ensure the accuracy, reliability, and integrity of data. - Implementing data governance practices to maintain data security, privacy, and compliance. - Conducting design and code reviews to ensure adherence to best practices and guidelines. - Working closely with architecture groups to drive optimized solutions and manage complex workflows. - Developing and maintaining Directed Acyclic Graphs (DAGs) for orchestrating data pipelines. - Preparing high-level and detailed technical design documents to facilitate data ingestion and transformation. - Following Agile methodology to deliver high-quality solutions and communicating effectively with stakeholders. - Analyzing project requirements and developing detailed specifications for new data warehouse reporting requirements. - Supporting projects and change initiatives aligned with key priorities of People Analytics and Insights. - Ensuring data security and mentoring other data engineers within the community. Qualifications Required: - 9+ years of data engineering experience - 7+ years of full lifecycle application, software development experience - 6+ years of experience in modern programming languages such as Python, Java, Spark, and Scala - 6+ years of SDLC experience in an Agile environment - 5+ years of hands-on experience with Snowflake, Azure Databricks, and Cloud technologies - Experience with Jenkins, GitHub, Spark, PySpark, and relational databases - Familiarity with Azure Services and Cloud deployments - Knowledge of APIs, CI/CD, data warehousing, and data governance concepts Preferred Qualifications: - Master's degree in Computer Science, Engineering, or Technology - Relevant certifications in data engineering or cloud platforms - Experience with People Data and disaster recovery models - Proficiency in creating user stories using agile methodologies Optum, a global organization under UnitedHealth Group, is committed to advancing health optimization on a global scale while promoting inclusivity and improving health outcomes for all individuals. As a Data Engineer at Optum, you will play a crucial role in architecting all phases of software engineering, focusing on business intelligence dataset development. Your responsibilities will include: - Supporting the full data engineering lifecycle by researching, designing, developing, testing, and maintaining end-to-end data processing systems and data management solutions. - Designing reusable components, frameworks, and libraries to enhance efficiency. - Contributing to the design and architecture to ensure secure, scalable, and maintainable solutions. - Collaborating with People Analytics to develop standard datasets for actionable decision-making. - Designing, building, and maintaining scalable data pipelines to process large volumes of data from various sources. - Integrating data from multiple sources while ensuring data quality and consistency. - Developing and managing databases, data warehouses, and data lakes for efficient data storage. - Utilizing data quality tools to ensure the accuracy, reliability, and integrity of data. - Implementing data governance practices to maintain data security, privacy, and compliance. - Conducting design and code reviews to ensure adherence to best practices and guidelines. - Working closely with architecture groups to drive optimized solutions and manage complex workflows. - Developing and maintaining Directed Acyclic Graphs (DAGs) for orchestrating data pipelines. - Preparing high-level and detailed technical design documents to facilitate data ingestion and transformation. - Following Agile methodology to deliver high-quality solutions and communicating effectively with stakeholders. - Analyzing project requirements and developing detailed specifications for new data warehouse reporting requirements. - Supporting projects and change initiatives aligned with key priorities of People Analytics and Insights. - Ensuring data security and mentoring other data engineers within the