ETL Developer

• Designing high-quality, secure, and scalable ETL frameworks and pipelines to ingest and extract the data.\n• Developing AWS Glue ETL jobs and big data solutions using Python and Pyspark.\n• Designing and developing the incremental and change data capture frameworks using Delta Lake.\n• Managing the data modernization across the organization by migrating the existing ETL jobs on legacy systems to cloud-based solutions.\n• Extensively using various AWS services like Glue, EMR, Lambda, Simple Notification Service (SNS), Cloud formation stack, Event bridge, Redshift, S3, EC2, and Athena.\n• Scheduling the ETL jobs using BMC Control-M and Apache Airflow.\n• Enhancing the long-running big data frameworks to reduce the cloud cost.\n• Writing the designs for data architecture of data warehouse or data lake solutions for end-to-end big data pipelines.\n• Designing/Developing data structures using Python and distributed computing using Apache Spark for better cost optimization.\n• Monitor and troubleshoot data pipelines, identifying root cause analysis (RCA) to minimize downtime and ensure optimal performance.\n• Implementing data warehouse concepts, such as Star, Snowflake Schema, and SCD Type 2 and 3.\n• Deploying code from lower environments to higher environments using CI/CD tools such as Git, Jenkins, Consul, and Terraform.\n• Extracting data from Athena tables using SQL and visualizing it for business use cases with tableau.\n• Executing data validation using SQL Queries and ICEDQ.\n• Working on various relational database systems such as Microsoft SQL Server, Aurora Postgres, and Oracle.\n• Creating comprehensive test plans and strategies based on business functional requirements.\n• Collaborating with cross-functional teams to ensure quality throughout the software development lifecycle.\n• Performing system testing, regression testing for the data generated through various ETL processes such as Glue, Information Power Center, IICS.\n• Participate in all agile ceremonies to understand the scope of work for a given release and perform high-level estimates for the project.\n\n

Labor Condition Application (ETA Form 9035 & 9035E) filed with the United States Department of Labor, Office of Foreign Labor Certification for a H-1B non-immigrant worker with the following details:\n1. Number of H1B non-immigrant workers included in LCA: \n1(One)\n2. Job Position: \nETL Developer\n3. Wages Offered:\n$101,192.00 to $101,193.00 per year \n4. Period of Employment: \n4/30/2024 to 4/29/2027\n5. Locations where H1B non-immigrant worker will work:\n1.\n1005 Goldfinch Dr,Celina,Texas-75009 \n \nComplaints alleging misrepresentation of material facts in the Labor Condition Application and/ or failure to comply with the terms of the Labor Condition Application may be filed with any office of the Wage & Hour Division of the United States Department of Labor.\n \nThe verification of Labor Condition Application (ETA Form 9035 & 9035E) will be available for all to review . \nhttps://us-west-2.graphassets.com/AhL7j39r8QqrJYMwlDWAYz/XsrLrqm9SB5rjlcH14de\n