Source description
About the role
Big Data Engineer (Spark/PySpark)
24 months
Must have 5+ years in Python
Must have strong have experience in both Apache Spark and PySpark and Scala
Hands-on experience with building high performing ETL/Data pipelines using Apache Spark and Big data ETL solutions.
Design and development experience with Python/PySpark/Scala.
Experience working with at least one of the big data technologies like Hadoop/HDFS/Hive/Iceberg/Kafka.
Experience with Python & Unix/Shell scripting.
Experience with CI/CD tools including GitHub, Jenkins, Artifactory, Sonar, UDeploy, Liquibase, Harness, Maven or Gradle.
More at 3B Staffing