Source description
About the role
What you will do? Write efficient code in the chosen technology for the project - For example - Spark, Apache Beam. Explore new technologies and learn new techniques to solve business problems creatively. Collaborate with many teams - engineering and business, to build better data products and services. Deliver the projects along with the team collaboratively and manage updates to customers on time. What are we looking for? 4 to 7 years of experience in Apache Spark. 2+ years of experience in writing ETL jobs using pySpark, and SparkSQL 2+ years of experience in SQL queries and stored procedures Have a deep understanding of all the Dataframe API with all the transformation functions supported by Spark 2.7+ You are preferred if you have Prior experience in working on AWS EMR, Apache Airflow Certifications - AWS Certified Big Data Specialty Cloudera or Hortonworks Certified Big Data Engineer Understanding of DataOps Engineering
More at Mactores