Padmi

Senior Data Engineer (Snowflake)

BangalorePosted 2 months ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at Luxoft

Opens the source posting on shine.com

Source description

About the role

View original

Project description Our Client is a leading global financial markets infrastructure and data provider. Their purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Team is responsible for managing a secure, scalable, and highly available cloud platform built on AWS, Azure, and Snowflake. Our mission is to deliver a strategic Common Data and Reporting solution for clients, members, and regulators by consolidating multiple data sources into a centralized reporting data store. This role offers the opportunity to work on cutting-edge cloud technologies and contribute to building a platform that transforms how data is leveraged across the business. Responsibilities Design, build, and optimize scalable data pipelines using Python, SQL, DBT, and Apache Airflow Develop and manage DBT models and ensure reliable workflow orchestration in Airflow Monitor and maintain Snowflake platform performance, availability, and cost efficiency Troubleshoot and resolve issues across data ingestion, transformation, and pipelines Implement and maintain end-to-end data quality testing and validation frameworks Automate deployments and workflows using GitLab CI/CD and support release processes Provide support to users and collaborate with teams on Snowflake, Airflow, and data solutions Document architecture and best practices while contributing to technical design, mentoring, and continuous improvement SKILLS Must have 7+ years of proven experience as a Senior Data Engineer Hands-on experience with Snowflake (preferred) or Databricks/Oracle Solid experience with DBT (data modeling and transformation) Experience with cloud platforms AWS (preferred) or Azure Strong SQL - advanced query writing and optimization skills Strong Python - experience in data processing and automation Basic CI/CD knowledge (GitLab or similar) - understanding of deployment pipelines Apache Airflow - workflow orchestration Data Build Tool - data transformation and modeling Nice to have Terraform - infrastructure as code Kafka - event streaming and messaging Project description Our Client is a leading global financial markets infrastructure and data provider. Their purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Team is responsible for managing a secure, scalable, and highly available cloud platform built on AWS, Azure, and Snowflake. Our mission is to deliver a strategic Common Data and Reporting solution for clients, members, and regulators by consolidating multiple data sources into a centralized reporting data store. This role offers the opportunity to work on cutting-edge cloud technologies and contribute to building a platform that transforms how data is leveraged across the business. Responsibilities Design, build, and optimize scalable data pipelines using Python, SQL, DBT, and Apache Airflow Develop and manage DBT models and ensure reliable workflow orchestration in Airflow Monitor and maintain Snowflake platform performance, availability, and cost efficiency Troubleshoot and resolve issues across data ingestion, transformation, and pipelines Implement and maintain end-to-end data quality testing and validation frameworks Automate deployments and workflows using GitLab CI/CD and support release processes Provide support to users and collaborate with teams on Snowflake, Airflow, and data solutions Document architecture and best practices while contributing to technical design, mentoring, and continuous improvement SKILLS Must have 7+ years of proven experience as a Senior Data Engineer Hands-on experience with Snowflake (preferred) or Databricks/Oracle Solid experience with DBT (data modeling and transformation) Experience with cloud platforms AWS (preferred) or Azure Strong SQL - advanced query writing and optimization skills Strong Python - experience in data processing and automation Basic CI/CD knowledge (GitLab or similar) - understanding of deployment pipelines Apache Airflow - workflow orchestration Data Build Tool - data transformation and modeling Nice to have Terraform - infrastructure as code Kafka - event streaming and messaging

One address, no account. We’ll tell you when matching roles go live.

More at Luxoft

Related open roles

View all roles