Padmi

Senior Azure Data Engineer ( Europe Based Candidates only )

MumbaiPosted 1 month ago
Software engineeringSeniorFull Time; Regular
Apply at AvanteNow

Opens the source posting on shine.com

Source description

About the role

View original

Job Title - Senior Azure Data Engineer Job Type - Occasional Travel to Barcelona and Munich Experience - 8+ Years Job Summary - * Create and build data ingestion pipelines using Azure Synapse Pipelines, Azure Functions, and Synapse Notebooks * Develop script in Python or PySpark for automation * Extract data from diverse sources including APIs, databases, flat files, and other cloud or on-premise systems. * Maintain and optimize Synapse Dedicated SQL Pools for data storage and analytical queries. * Manage code using Git for source control and CI/CD, ensuring consistent and governed deployment of pipelines and artifacts across environments. * Automate failure handling, alerts, and retries to minimize operational overhead * Collaborate with different stakeholders to ensure that data meets business needs and is delivered on time. * Provide technical troubleshooting, issue resolution, and continuous support for data delivery pipelines. * Ensure adherence to security, privacy, and development guidelines. * Document processes and data flows for transparency and knowledge sharing. * Identify opportunities for standardization and automate data maintenance processes. * Foster a data-driven culture and advocate for the benefits of data management. * Engage with leadership and functional leads to ensure alignment and support. What you bring * 8+ years of experience in Azure Synapse Analytics (pipelines, notebooks, SQL pools) * Azure Data Lake Storage Gen2 (architecture, management, security) * Python & PySpark (data processing, automation) * T-SQL (complex queries, procedures) * Development of ETL/ELT workflows using modern orchestration tools * RESTful API design & integration * Experience with Databricks is nice to have * Azure Functions & Logic Apps (event-driven/serverless) * Security: Azure RBAC, Managed Identities, Key Vault * Monitoring & alerting (Azure Monitor, Log Analytics) * Familiarity with ServiceNow APIs is an added advantage * Experience in CI/CD and GitHub Actions is a plus PowerShell, YAML Azure CLI is a plus Job Title - Senior Azure Data Engineer Job Type - Occasional Travel to Barcelona and Munich Experience - 8+ Years Job Summary - * Create and build data ingestion pipelines using Azure Synapse Pipelines, Azure Functions, and Synapse Notebooks * Develop script in Python or PySpark for automation * Extract data from diverse sources including APIs, databases, flat files, and other cloud or on-premise systems. * Maintain and optimize Synapse Dedicated SQL Pools for data storage and analytical queries. * Manage code using Git for source control and CI/CD, ensuring consistent and governed deployment of pipelines and artifacts across environments. * Automate failure handling, alerts, and retries to minimize operational overhead * Collaborate with different stakeholders to ensure that data meets business needs and is delivered on time. * Provide technical troubleshooting, issue resolution, and continuous support for data delivery pipelines. * Ensure adherence to security, privacy, and development guidelines. * Document processes and data flows for transparency and knowledge sharing. * Identify opportunities for standardization and automate data maintenance processes. * Foster a data-driven culture and advocate for the benefits of data management. * Engage with leadership and functional leads to ensure alignment and support. What you bring * 8+ years of experience in Azure Synapse Analytics (pipelines, notebooks, SQL pools) * Azure Data Lake Storage Gen2 (architecture, management, security) * Python & PySpark (data processing, automation) * T-SQL (complex queries, procedures) * Development of ETL/ELT workflows using modern orchestration tools * RESTful API design & integration * Experience with Databricks is nice to have * Azure Functions & Logic Apps (event-driven/serverless) * Security: Azure RBAC, Managed Identities, Key Vault * Monitoring & alerting (Azure Monitor, Log Analytics) * Familiarity with ServiceNow APIs is an added advantage * Experience in CI/CD and GitHub Actions is a plus PowerShell, YAML Azure CLI is a plus

One address, no account. We’ll tell you when matching roles go live.

More at AvanteNow

Related open roles

View all roles