Senior Data Platform and Integration Engineer

Senior Data Platform and Integration Engineer - J50692 Role & responsibilities Job Location: Juinagar, Navi Mumbai Work Mode: Hybrid (3 days/week in office) Job Responsibilities: • Collaborate with business stakeholders, product owners and leadership to translate business requirements into scalable data solutions. • Define and evolve the target architecture for companies enterprise data platform spanning Azure, Snowflake, Databricks and SAP BTP. • Establish an API-first integration strategy (REST, event-driven, microservices) and govern its adoption across teams.• Drive the Clean Core strategy, enabling agile side-by-side extensions through SAP BTP while protecting the SAP S/4HANA core. • Design and govern a secure Data Marketplace with automated classification, lineage and access policies using Microsoft Purview and Snowflake Horizon. • Define architectural standards, design patterns, and best practices for data ingestion, transformation, and distribution. • Evaluate and recommend emerging technologies (Microsoft Fabric, Snowflake Cortex/Intelligence, Databricks Genie, RAG/AI) to advance the platform roadmap. Hands On Experience: • Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, and distribution across cloud environments. • Build and manage integrations between SAP and non-SAP enterprise systems and cloud data platforms (Azure Data Factory, Databricks, Snowflake). • Implement real-time data streaming and Change Data Capture (CDC) mechanisms using Kafka, Azure Event Hub, or similar technologies. • Develop API-based and event-driven integration solutions, including authentication (OAuth2, OIDC) and API gateway configuration. • Design advanced data models (relational, star, snowflake schemas) optimized for analytical workloads in Snowflake and Databricks. • Automate deployment and lifecycle management using CI/CD pipelines (Azure DevOps, GitHub Actions, or equivalent). • Optimize pipeline performance, scalability, and cost efficiency; troubleshoot and resolve production issues. • Implement data governance, security controls, encryption and lineage tracking within the platform. Qualification: • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field. • 6+ years of professional experience in data engineering, data platform architecture, or cloud-based integration — with a demonstrable mix of strategic design and hands-on implementation. • Strong proficiency in SQL and Python; additional experience with R or Java is a plus. • Deep hands-on experience with Microsoft Azure services (Data Lake, Data Factory, Databricks) and Snowflake architecture and optimization.• Proven expertise in ETL/ELT frameworks and tools, including batch, CDC and streaming patterns. • Strong knowledge of API-driven architectures, REST APIs, event-driven messaging (Kafka, Event Hub, Service Bus), and authentication protocols (OAuth2, OIDC). • Experience integrating SAP systems (S/4HANA, BTP, Datasphere) with cloud data platforms. • Solid understanding of data governance, security, encryption and lineage principles. • Experience with CI/CD practices and infrastructure-as-code. • Strong analytical, communication, and stakeholder management skills; comfortable working in cross-functional, international teams using agile methodologies. Preferred Skills & Experience: • Experience with Microsoft Fabric and Power Platform / Power BI. • Hands-on exposure to AI/ML capabilities on Snowflake (Cortex, Intelligence), Databricks (Genie), or SAP Joule. • Relevant certifications in Azure, Snowflake or Databricks. • Experience in regulated industries such as pharmaceuticals or healthcare • Understanding of Pharma 4.0 (the pharmaceutical-industry analog to Industrie 4.0) — digitalization of GxP-regulated manufacturing and quality processes, including MES/LIMS integration, data integrity and connectivity between shop-floor (OT) and enterprise (IT) systems.