Consulting Data Engineer

In this role as a Consulting/Principal Data Engineer at our global team, you will be responsible for leading the evolution of our data platform by translating high-level requirements into scalable technical solutions and ensuring the reliability, flexibility, and trustworthiness of our data platform. Your responsibilities will include: - Serving as a primary technical point of contact for stakeholders - Refining high-level requirements into clear technical designs and actionable work - Writing and reviewing portions of detailed specifications for system components - Designing and delivering scalable batch and streaming data solutions - Collaborating closely with Product Managers, Architects, and Engineering teams - Building and enhancing our data platform using the latest technologies - Ensuring data quality, reliability, and governance through strong processes and monitoring - Providing technical leadership, mentorship, and coaching to team members Requirements for this role include: - 8+ years of experience in data engineering or data platform development - Strong hands-on experience with Python based API and ORM frameworks, pySpark, SQL, AWS (Glue, Lambda, SQS, Kinesis, RDS), Kafka, Snowflake, DBT, and Terraform - Experience designing both batch and real-time data pipelines - Experience working in Agile/Scrum environments with iterative delivery practices - Strong understanding of data modeling, data quality, and platform best practices - Excellent stakeholder communication and leadership skills - Experience guiding and mentoring engineers - Strong collaboration skills, with the ability to work effectively with cross-functional teams - Advocate of Continuous Integration/Continuous Deployment (CI/CD) and Test-Driven Development TDD At our organization, we promote a healthy work-life balance and offer various well-being initiatives to support your overall well-being. Some of the benefits we offer include comprehensive health insurance, flexible working arrangements, employee assistance programs, modern family benefits, various paid time off options, free transport for home-office-home commutes, and more. As a global leader in information and analytics, we assist researchers and healthcare professionals in advancing science and improving health outcomes for society's benefit. At Elsevier, your work contributes to addressing the world's grand challenges and fostering a sustainable future using innovative technologies to support science and healthcare for a better world. In this role as a Consulting/Principal Data Engineer at our global team, you will be responsible for leading the evolution of our data platform by translating high-level requirements into scalable technical solutions and ensuring the reliability, flexibility, and trustworthiness of our data platform. Your responsibilities will include: - Serving as a primary technical point of contact for stakeholders - Refining high-level requirements into clear technical designs and actionable work - Writing and reviewing portions of detailed specifications for system components - Designing and delivering scalable batch and streaming data solutions - Collaborating closely with Product Managers, Architects, and Engineering teams - Building and enhancing our data platform using the latest technologies - Ensuring data quality, reliability, and governance through strong processes and monitoring - Providing technical leadership, mentorship, and coaching to team members Requirements for this role include: - 8+ years of experience in data engineering or data platform development - Strong hands-on experience with Python based API and ORM frameworks, pySpark, SQL, AWS (Glue, Lambda, SQS, Kinesis, RDS), Kafka, Snowflake, DBT, and Terraform - Experience designing both batch and real-time data pipelines - Experience working in Agile/Scrum environments with iterative delivery practices - Strong understanding of data modeling, data quality, and platform best practices - Excellent stakeholder communication and leadership skills - Experience guiding and mentoring engineers - Strong collaboration skills, with the ability to work effectively with cross-functional teams - Advocate of Continuous Integration/Continuous Deployment (CI/CD) and Test-Driven Development TDD At our organization, we promote a healthy work-life balance and offer various well-being initiatives to support your overall well-being. Some of the benefits we offer include comprehensive health insurance, flexible working arrangements, employee assistance programs, modern family benefits, various paid time off options, free transport for home-office-home commutes, and more. As a global leader in information and analytics, we assist researchers and healthcare professionals in advancing science and improving health outcomes for society's benefit. At Elsevier, your work contributes to addressing the world's grand challenges and fostering a sustainable future using innovative technologies to support scien