Senior Data Engineer

Job Title: Senior Data Engineer

Key Skills: DBT, Python, SQL, Snowflake, Databricks

Location: Brazil

Mode: Remote

We at Coforge are hiring Senior Data Engineer with the following skill set.

Key Responsibilities

• Delivery & Ownership

• Own the end-to-end delivery of data pipelines and data products, from design through deployment and production support

• Develop, maintain, and optimise scalable data pipelines using Azure Databricks, DBT, and Python

• Ensure solutions are production-ready, reliable, and meet defined SLAs

• Migration & Platform Engineering

• Execute and support migration of data from Snowflake (AWS) to Azure using Databricks, DBT, and Lakebridge

• Build and manage infrastructure-as-code using Terraform to enable scalable and repeatable deployments

• Ensure seamless integration between legacy systems and the Azure data platform

• Data Quality, Observability & Governance

• Implement data quality frameworks (e.g., DBT testing, validation rules) to ensure trusted data pipelines

• Enable observability through logging, monitoring, and alerting of pipelines and data workflows

• Support data governance standards including data lineage, consistency, and compliance requirements

• Architecture & Engineering Excellence

• Contribute to the design and architecture of scalable data solutions, aligned with lakehouse principles

• Apply best practices in data modelling, performance optimisation, and cost efficiency

• Follow and promote engineering standards, including modular design and reusable components

• Production Support & Reliability

• Monitor and maintain data pipelines in production, ensuring high availability and performance

• Troubleshoot issues and perform root cause analysis (RCA) for incidents

• Continuously improve system stability, resilience, and operational processes

• Collaboration & Technical Leadership

• Work closely with cross-functional teams (data, product, architecture, business) to translate requirements into scalable technical solutions

• Provide guidance and mentorship to junior engineers through code reviews and best practices

• Contribute to documentation of architecture, pipelines, and operational processes

Required Skills & Qualifications

• Strong hands-on expertise with: Azure Databricks, DBT, Snowflake, Python and SQL

• Proven experience building and managing large-scale data pipelines and transformations

• Experience working with high-volume datasets (e.g., terabytes, complex data models, multiple pipelines)

• Solid understanding of: Data modelling and ETL/ELT frameworks, Distributed data systems and lakehouse architectures, Experience with Terraform and infrastructure-as-code principles

• Strong experience with CI/CD pipelines and Git-based version control

• Experience supporting production systems, including monitoring, alerting, and incident resolution

• Knowledge of data quality, testing, and observability frameworks

• Strong problem-solving and analytical skills

• Excellent communication skills with the ability to work across technical and non-technical stakeholders

• Experience in insurance or financial services domains is highly desirable

Preferred Skills:

• Experience with real-time/streaming technologies (Kafka, Event Hubs, Delta Live Tables)

• Knowledge of security, compliance, and data protection standards in regulated industries

• Experience with cost optimisation and performance tuning in cloud environments

• Exposure to multi-cloud or hybrid architectures

Posted On: 14-07-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.