Source description
About the role
Responsibilities: Design, build, and maintain data pipelines using AWS services (Glue, Neptune, S3). Participate in code reviews, testing, and optimization of data pipelines. Collaborate with stakeholders to understand data requirements and translate into technical solutions. Requirements: • Proven experience as a Senior Data Engineer / Data Architect, or similar role. • Knowledge of data governance and security practices. • Extensive experience with data lake technologies (NiFi, Spark, Hive Metastore, Object Storage, Delta Lake Framework) • Extensive experience with AWS cloud services, including AWS Glue, Neptune, S3 and Lambda • Experience with AWS Neptune or other graph database technologies. • Experience in data modelling and design. • Experience with event driven architecture • Experience with Python • Experience with SQL • Strong problem-solving skills and attention to detail. • Excellent communication and teamwork skills. Nice to have: • Experience with observability solutions (Splunk, New Relic) • Experience with Infrastructure as Code (Terraform, CloudFormation) • Experience with CICD (Jenkins) • Experience with Kubernetes • Familiarity with data visualization tools. Support Engineer Similar skills as the above, but with more of a support focus, able to troubleshoot, patch and upgrade, minor enhancements and fixes to the infrastructure and pipelines. Experience with observability, cloudwatch, new relic and monitoring.
More at Logic Planet