Senior Data Engineer

Job Title:Senior Data Engineer Employment Type:Full Time, PermanentPosition Location: Hyderabad Reports to: Software Development Manager (IT Solutions Delivery) Qualifications: BE/B.Tech/MCA Degree in Computer Science, Engineering, or similar relevant field Total Experience: 7-10 years Working Model: Work from office Required Qualifications Azure data services hands-on experience with Event Hubs, Azure Functions, Azure Data Factory, ADLS Gen2, Key Vault, and Service Bus Power BI designing, building, and deploying dashboards and semantic models; Power BI deployment pipelines (devtestprod promotion); connecting reports to curated Lakehouse/ADLS data sources Infrastructure as Code Terraform for provisioning and managing cloud resources CI/CD pipelines— building and maintaining Azure DevOps pipelines (multi-stage, environment gating, artifact promotion) Streaming / event-driven architecture— designing and operating real-time data pipelines (CDC, event streaming, consumer group patterns) Medallion / Lakehouse architecture— experience building RawValidCurated data layers SQL— T-SQL for data transformation and validation Source control discipline— feature-branch workflows, PR reviews, structured commit practices Python— production Python development (3.10+); building event-driven or streaming applications Preferred Qualifications Kubernetes / AKS— deploying and operating workloads on Azure Kubernetes Service; Helm chart management Security-first data engineering— PII handling, tokenization patterns, Managed Identity (DefaultAzureCredential), private endpoints, RBAC. Experience integrating third-party tokenization SDKs or working with PII governance framework; understanding of tokenize/detokenize patterns in streaming pipelines Observability— OpenTelemetry instrumentation, Azure Monitor / Application Insights, custom telemetry dimensions Debezium / CDC— Change Data Capture from relational sources (Informix, SQL Server, etc.) into event streams Testing discipline— pytest, mocking external dependencies, contract/integration test patterns Python packaging—uv, dependency pinning, reproducible builds for serverless deployments Cross-repo platform thinking— working within a multi-repo data platform where pipelines, infrastructure, and application code are owned separately