Source description
About the role
Relevant education within Computer Science, Mathematics, Economics, Information Management, or Statistics
3+ years of experience as a Data Engineer or in a Software engineering role with focus on data
Hands-on with git
Coding best practices
Unit testing
Experience with at least one object oriented or functional/scripting languages – Java, Scala, Python etc.
DevOps and CI/CD focus
Experience working with relational data sets using SQL
Experience building, and optimizing data pipelines, architectures, and datasets
Experience working with Azure, AWS or other cloud providers
Agile mindset and experience of Scrum
It’s a plus if you have worked with:
big data: Spark, Databricks, and Hadoop
data pipeline and workflow tools: Airflow, ADF, Luigi, etc.
infrastructure: Docker, Kubernetes and Helm; we’re using Airflow running on Kubernetes
stream-processing systems: Kafka and Spark Streaming
Job type: Full Time/Contract Division: eTeam Workforce Limited Reference: 22-03288
More at eTeam