Source description
About the role
We are seeking a skilled Data Engineer to join our team, specializing in building and maintaining modern data pipelines using ETL/ELT methodologies. The ideal candidate will have extensive experience in transforming unstructured data into structured datasets, creating CI/CD automation, and ensuring high-quality, validated data for analytical purposes. Built and maintained scalable ELT pipelines using Databricks Developed robust data models with advanced SQL (CTEs, window functions, joins) Implemented CI/CD pipelines for dbt projects using Git Automated data validation using Python and Q-Test Managed version control, code reviews, and pull requests Migrated data across diverse sources (Excel, XML, JSON, SQL Server) Resolved production issues and ensured data reliability Collaborated with stakeholders to deliver data-driven solutions Created technical documentation and knowledge base artifacts Integrated Databricks APIs with React applications on AWS Implemented IAM security, CI/CD, and CloudWatch monitoring Optimized system performance for scalability and availability Configured end-to-end integration between Databricks APIs and React frontend applications on AWS, implementing CI/CD pipelines, IAM-based security, monitoring with CloudWatch, and optimized compute/storage setup for high availability and performance. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
More at ADP
Related open roles
Servicenow - Platform Engineering and Support 170155 (Telangana)
Hyderabad
Servicenow Platform Engineering And Support 170155 Telangana (India)
India
Servicenow - Platform Engineering and Support 170155
Hyderabad
GETS-Developer Experience 170151
Hyderabad
GETS-Developer Experience 170152
Hyderabad
Senior AI Operations Engineer
Barcelona