Source description
About the role
Technical Requirements :
- AWS: S3, Glue, Lambda, Step Function, Eventbridge, Cloudwatch, EMR, Secrets Manager, IAM
- Infrastructure as Code (IaC): Terraform
- Continuous Integration / Continuous Deployment (CI/CD): Jenkins, Gitlab
- Coding: Python, SQL, Spark/PySpark
- Data Engineering: Data pipeline development, DevOps, ETL / ELT design patterns, Batch vs real-time processing, Schema evolution and data partitioning, Problem-solving and debugging
- Good to have: Starburst, Teradata, Iceberg
More at EXL