Spclst, Data Engineering

As a Specialist, Data Engineering at a global healthcare biopharma company based in Hyderabad, your role involves designing, developing, and maintaining data pipelines to extract data from various sources and populate a data lake and data warehouse. You will work closely with data scientists, analysts, and business teams to understand data requirements and deliver solutions aligned with business goals. Your responsibilities include: - Building and maintaining platforms that support data ingestion, transformation, and orchestration across various data sources, both internal and external. - Using data orchestration, logging, and monitoring tools to build resilient pipelines and automate data flows for scalability, performance, and resilience of the platform. - Monitoring, troubleshooting, and resolving issues related to the data integration platform to ensure uptime and reliability. - Maintaining thorough documentation for integration processes, configurations, and code for easy onboarding of new team members and future scalability. - Developing pipelines to ingest data into cloud data warehouses and establishing, modifying, and maintaining data structures and associated components. - Creating and delivering standard reports in accordance with stakeholder needs and agreed standards, while participating in project planning, execution, and delivery to ensure alignment with both functional and project goals. Qualifications required for this role include: - Bachelor's degree in information technology, Computer Science, or any Technology stream. - 4+ years of experience in developing data pipelines & data infrastructure, ideally within a drug development or life sciences context. - Expertise in delivering large-scale information management technology solutions encompassing data integration and self-service analytics enablement. - Proficiency in software/data engineering practices, design, build, and unit testing applications on Spark framework using Python. - Experience with storage frameworks like Delta Lake/Iceberg, MPP Datawarehouse's like Redshift, and cloud-native technologies, ideally AWS certified. - Strong interpersonal and communication skills, a customer-centric approach, and a track record of delivering high-quality results with an innovative and experimental mindset. Primary Skills required for this role include Pyspark, Python, Databricks, AWS, and CI/CD concepts. As part of a collaborative and innovative technology team, you will propose ideas and solutions to enable new organizational capabilities, delivering services and solutions that drive productivity and innovation. The company you will be joining, known as Merck & Co., Inc., Rahway, New Jersey, USA, has a rich legacy of inventing and delivering medicines and vaccines for challenging diseases globally. As part of this team, you will have the opportunity to contribute to saving and improving lives around the world, leveraging your skills and expertise in data engineering. If you are intellectually curious and passionate about making a meaningful impact, this role offers you the chance to work with a diverse group of colleagues towards a common goal of bringing hope to those battling challenging diseases. Join this evolving team and start making a difference today. As a Specialist, Data Engineering at a global healthcare biopharma company based in Hyderabad, your role involves designing, developing, and maintaining data pipelines to extract data from various sources and populate a data lake and data warehouse. You will work closely with data scientists, analysts, and business teams to understand data requirements and deliver solutions aligned with business goals. Your responsibilities include: - Building and maintaining platforms that support data ingestion, transformation, and orchestration across various data sources, both internal and external. - Using data orchestration, logging, and monitoring tools to build resilient pipelines and automate data flows for scalability, performance, and resilience of the platform. - Monitoring, troubleshooting, and resolving issues related to the data integration platform to ensure uptime and reliability. - Maintaining thorough documentation for integration processes, configurations, and code for easy onboarding of new team members and future scalability. - Developing pipelines to ingest data into cloud data warehouses and establishing, modifying, and maintaining data structures and associated components. - Creating and delivering standard reports in accordance with stakeholder needs and agreed standards, while participating in project planning, execution, and delivery to ensure alignment with both functional and project goals. Qualifications required for this role include: - Bachelor's degree in information technology, Computer Science, or any Technology stream. - 4+ years of experience in developing data pipelines & data infrastructure, ideally within a drug development or life sciences context. - E