Source description
About the role
Job Description We are seeking an experienced and handson Data Engineer with strong expertise in AWS and Databricks to join our growing data engineering team. The ideal candidate will be passionate about building scalable data pipelines and delivering highquality data solutions. Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services Handson development using Python, Scala, and SQL Orchestrate workflows and manage job scheduling Optimize and monitor Databricks jobs for performance and reliability Work with large-scale datasets and implement best practices for data ingestion and processing Collaborate with crossfunctional teams to understand business requirements and translate them into technical solutions Root cause analysis and performance tuning Document data engineering processes and developer guides Work in an Agile environment using tools like JIRA Batch ETL experience is essential; realtime pipeline experience is a plus Exposure to Google Cloud Platform (GCP) is a plus Required Skills & Experience 3+ years of handson experience with Databricks 5+ years of experience with AWS data engineering services Strong proficiency in Python and Scala Experience with ETL development and SQL Knowledge of workflow orchestration tools Experience with monitoring, tuning, and debugging Databricks jobs Ability to perform root cause analysis and improve data quality/processes Experience working in Agile teams and using JIRA Job Description We are seeking an experienced and handson Data Engineer with strong expertise in AWS and Databricks to join our growing data engineering team. The ideal candidate will be passionate about building scalable data pipelines and delivering highquality data solutions. Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services Handson development using Python, Scala, and SQL Orchestrate workflows and manage job scheduling Optimize and monitor Databricks jobs for performance and reliability Work with large-scale datasets and implement best practices for data ingestion and processing Collaborate with crossfunctional teams to understand business requirements and translate them into technical solutions Root cause analysis and performance tuning Document data engineering processes and developer guides Work in an Agile environment using tools like JIRA Batch ETL experience is essential; realtime pipeline experience is a plus Exposure to Google Cloud Platform (GCP) is a plus Required Skills & Experience 3+ years of handson experience with Databricks 5+ years of experience with AWS data engineering services Strong proficiency in Python and Scala Experience with ETL development and SQL Knowledge of workflow orchestration tools Experience with monitoring, tuning, and debugging Databricks jobs Ability to perform root cause analysis and improve data quality/processes Experience working in Agile teams and using JIRA
More at Tekskills