Source description
About the role
As a skilled Data Engineer with 6 to 12 years of experience in data warehouse projects, you will be responsible for designing, developing, and optimizing data pipelines and ETL processes. Your expertise in Snowflake and hands-on knowledge of Azure Data Factory (ADF) and dbt (Data Build Tool) will be crucial for this role. Proficiency in Python scripting would be an added advantage. Your primary location for this position will be in Bangalore. Key Responsibilities: - Design, develop, and optimize data pipelines and ETL processes for data warehousing projects. - Work extensively with Snowflake to ensure efficient data modeling and query optimization. - Develop and manage data workflows using Azure Data Factory (ADF) for seamless data integration. - Implement data transformations, testing, and documentation using dbt. - Collaborate with cross-functional teams to ensure data accuracy, consistency, and security. - Troubleshoot data-related issues. Qualifications Required: - Experience in Data Warehousing with a strong understanding of best practices. - Hands-on experience with Snowflake (Data Modeling, Query Optimization). - Proficiency in Azure Data Factory (ADF) for data pipeline development. - Strong working knowledge of dbt (Data Build Tool) for data transformations. - Optional experience in Python scripting for automation and data manipulation. - Good understanding of SQL and query optimization techniques. - Experience in cloud-based data solutions (Azure). - Strong problem-solving skills and ability to work in a fast-paced environment. - Experience with CI/CD pipelines for data engineering. As a skilled Data Engineer with 6 to 12 years of experience in data warehouse projects, you will be responsible for designing, developing, and optimizing data pipelines and ETL processes. Your expertise in Snowflake and hands-on knowledge of Azure Data Factory (ADF) and dbt (Data Build Tool) will be crucial for this role. Proficiency in Python scripting would be an added advantage. Your primary location for this position will be in Bangalore. Key Responsibilities: - Design, develop, and optimize data pipelines and ETL processes for data warehousing projects. - Work extensively with Snowflake to ensure efficient data modeling and query optimization. - Develop and manage data workflows using Azure Data Factory (ADF) for seamless data integration. - Implement data transformations, testing, and documentation using dbt. - Collaborate with cross-functional teams to ensure data accuracy, consistency, and security. - Troubleshoot data-related issues. Qualifications Required: - Experience in Data Warehousing with a strong understanding of best practices. - Hands-on experience with Snowflake (Data Modeling, Query Optimization). - Proficiency in Azure Data Factory (ADF) for data pipeline development. - Strong working knowledge of dbt (Data Build Tool) for data transformations. - Optional experience in Python scripting for automation and data manipulation. - Good understanding of SQL and query optimization techniques. - Experience in cloud-based data solutions (Azure). - Strong problem-solving skills and ability to work in a fast-paced environment. - Experience with CI/CD pipelines for data engineering.
More at IDESLABS