Source description
About the role
Responsibilities Use the latest technology to build data pipelines and integrate machine learning models Build and expand our data platform Develop applications that run on a Google Cloud-based infrastructure Qualifications 5+ years of experience in Big Data and Data Engineering Strong knowledge of advanced SQL and data warehousing concepts, including BigQuery Strong programming skills in SQL, Python/PySpark etc. Experience in the design and development of data pipelines, ETL/ELT processes Experience in one of the public cloud providers GCP, Azure, AWS Experience with relational SQL and NoSQL databases, including Postgres and MongoDB Experience with workflow management tools: Airflow, AWS Data Pipeline, Google Cloud Composer Comfortable using Azure DevOps or similar CI/CD tools, Git Building Docker images and deploying them to production. Integrate Docker container orchestration with Kubernetes by creating pods, ConfigMaps, and deployments using Terraform Strong problem solving and communication skills Bachelor's or an advanced degree in Computer Science or related engineering discipline Optionally have experience with C#, .NET Core, and microservices
More at TechBlocks