Padmi

Databricks Developer

Delhi NCRPosted 3 months ago
Software engineeringMid-levelFull Time; Regular
Apply at Damco Solutions

Opens the source posting on shine.com

Source description

About the role

View original

As a Databricks Developer at our company, you will be part of the data engineering team. Your role will involve building and maintaining ETL pipelines, optimizing data models, and contributing to reporting processes. You will have the opportunity to work with Databricks and cloud technologies, playing a crucial role in various data management and reporting initiatives. Key Responsibilities: - Build, test, and maintain scalable ETL pipelines using Databricks and Apache Spark. - Contribute to the development of data models and optimize queries for performance and efficiency. - Participate in the design and implementation of data governance practices to ensure data quality and consistency across pipelines. - Assist in the implementation and maintenance of the medallion architecture (bronze, silver, gold layers) to streamline data processing and reporting. - Collaborate with cross-functional teams to integrate data management and reporting processes into broader business initiatives. - Troubleshoot and optimize Databricks workflows to enhance performance and reduce costs. - Maintain clear documentation of ETL pipelines, data models, and governance procedures to ensure transparency and scalability. Qualifications Required: - Experience in Databricks for building ETL pipelines. - Experience in building data models and optimizing queries. - Experience with data management and reporting processes. - Experience with medallion architecture and data governance. This opportunity will not only allow you to enhance your skills in Databricks and cloud technologies but also contribute significantly to key data management and reporting projects within the company. As a Databricks Developer at our company, you will be part of the data engineering team. Your role will involve building and maintaining ETL pipelines, optimizing data models, and contributing to reporting processes. You will have the opportunity to work with Databricks and cloud technologies, playing a crucial role in various data management and reporting initiatives. Key Responsibilities: - Build, test, and maintain scalable ETL pipelines using Databricks and Apache Spark. - Contribute to the development of data models and optimize queries for performance and efficiency. - Participate in the design and implementation of data governance practices to ensure data quality and consistency across pipelines. - Assist in the implementation and maintenance of the medallion architecture (bronze, silver, gold layers) to streamline data processing and reporting. - Collaborate with cross-functional teams to integrate data management and reporting processes into broader business initiatives. - Troubleshoot and optimize Databricks workflows to enhance performance and reduce costs. - Maintain clear documentation of ETL pipelines, data models, and governance procedures to ensure transparency and scalability. Qualifications Required: - Experience in Databricks for building ETL pipelines. - Experience in building data models and optimizing queries. - Experience with data management and reporting processes. - Experience with medallion architecture and data governance. This opportunity will not only allow you to enhance your skills in Databricks and cloud technologies but also contribute significantly to key data management and reporting projects within the company.

One address, no account. We’ll tell you when matching roles go live.

More at Damco Solutions

Related open roles

View all roles
Databricks Developer at Damco Solutions · Padmi