Source description
About the role
We are looking for a highly skilled Data Engineer with expertise in Spark and Airflow to join our team. The ideal candidate will have a strong background in data processing and analysis, with the ability to design and implement efficient data pipelines. Roles and Responsibility Design, develop, and maintain large-scale data pipelines using Spark and Airflow. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and implement data quality checks and validation processes to ensure data integrity. Optimize data processing workflows for performance and scalability. Troubleshoot and resolve technical issues related to data engineering projects. Participate in code reviews and contribute to improving overall code quality. Job Requirements Strong experience in data engineering, preferably with Spark and Airflow. Proficiency in programming languages such as Python or Java. Experience with big data technologies and data warehousing concepts. Excellent problem-solving skills and attention to detail. Ability to work collaboratively in a team environment. Strong communication and interpersonal skills. Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
More at Workforce Next