Data Engineer

Job title: Senior Data Engineer Experience:3+yrs Location: Hyderabad Work type: Hybrid Roles & Responsibilities: • At least 3+yrs years of experience in application design, development and analysis • Experience in AWS Cloud Solutions & GCP. Retail Industry experience preferred. • Implement data transformations and data structures for data warehouse and lake/repository. • Manage cloud and/or on-premises solutions for data transfer and storage. • Process data using spark (PySpark) • Manage cloud and/or on-premises solutions for data transfer and storage. • Collaborate and work with data analysts in various functions to ensure that data meets their reporting and analysis needs. • Experience in creating Various ETL Frameworks in processing or extracting the data from cloud databases by using AWS Services by leveraging Lambda, Glue, PySpark, Step Functions, SNS, SQS and Batch. • Proven ability to be a strategic thinker to drive the necessary ownership and data governance within the organization • Ability to evaluate risks and provide business recommendations / solutions in a timely manner • Ability to remain calm in high stress situations while navigating and leading during times of conflict • Should have sound knowledge in various AWS Services • Able to understand the existing Frameworks built in AWS PySpark and Glue • Able to scan ETL Frameworks and propose optimizations and cost savings. • Able to work independently and able to take key decisions. • Comfortable interacting with stakeholders at all levels through Business and IT. • Ability to express complex concepts effectively, both verbally and in writing to IT & Business partners • Understanding of and experience working in an Agile environment • Knowledge on Talend Cloud ETL,Kafka, Snowflake Cloud and PowerBI is addon • Independent. Strong critical thinking, decision making, troubleshooting and problem-solving skills.