ETL Developer with AWS Glue

Role: ETL Developer with AWS Glue Exp.

Yrs of exp: 8-12 yrs,

JD:

We are looking for ETL Developers with AWS Glue experience. Below is the JD.

ETL Dev:

Design and develop scalable ETL pipelines using AWS services such as:

AWS Glue for serverless data integration

AWS Lambda for lightweight transformations

Integrate data from diverse sources including APIs, databases, and flat files into AWS-based data platforms.

Implement data transformation logic using PySpark, SQL within AWS Glue

Monitor, schedule, and orchestrate ETL workflows using AWS Step Functions, Glue Workflows, or Apache Airflow on Amazon MWAA.

Ensure data quality, consistency, and lineage using AWS Glue Data Catalog and AWS Lake Formation.

Optimize ETL performance and cost-efficiency through partitioning, parallelism, and resource tuning.

Document ETL processes, data flows, and architecture using tools like AWS Architecture Diagrams or Confluence.