Data Engineer - Data Lake

Department: Technology Our Company Promise We are committed to provide our Employees a stable work environment with equal opportunity for learning and personal growth. Creativity and innovation are encouraged for improving the effectiveness of Southwest Airlines. Above all, Employees will be provided the same concern, respect, and caring attitude within the organization that they are expected to share externally with every Southwest Customer. Job Description: About Us At Southwest Airlines, we believe that flying should feel like freedom. For over 50 years, weve been connecting people to what matters most with low fares, legendary hospitality, and a heart for service. Our culture is built on the principles of fun,friendliness, andfamily, making us one of the most admired workplaces in the world. If youre passionate about making a difference, love working in a fast-paced environment, and want to help millions of travelers reach their destinations with a smile, Southwest Airlines is the place for you. Here, your career can truly take flight. Job Summary The Data Lake 2.0 Pod builds the shared data foundation that powers analytics, AI, and machine learning across Southwest. Using modern cloud architectures and a DevOps mindset, the team creates scalable, reusable frameworks that help hundreds of application teams securely collect, store, and access enterprise data.As a Data Engineer on the Data Lake 2.0 Pod, you'll build and support reliable data pipelines that deliver highquality, governed data across Southwest's enterprise data platform. Working alongside engineers in our Hyderabad and U.S. teams, you'll help improve platform scalability, automate processes, and apply modern cloud engineering practices to solve complex data challenges. This role offers the opportunity to deepen your AWS and data engineering expertise while helping teams across the Company unlock the value of data for analytics, AI, and business decisionmaking. ResponsibilitiesAssemble large, complex sets of data that meet non-functional and functional business requirementsIdentify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processesBuild required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologiesBuild analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisitionWork with stakeholders including data, design, product and executive teams and assisting them with data-related technical issuesWork with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issuesGenerate or adapt equipment and technology to serve user needsMay perform other job duties as directed by Employee's Leaders Knowledge, Skills and AbilitiesKnowledge of the practical application of engineering science and technology, including applying principles, techniques, procedures, and equipment to the design and production of various goods and servicesKnowledge of design techniques, tools, and principles involved in production of precision technical plans, blueprints, drawings, and modelsAbility to use logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions or approaches to problemsAbility to understand new information for both current and future problem-solving and decision-makingSkilled in identifying complex problems and reviewing related information to develop and evaluate options and implement solutionsAbility to recognize when an issue has occurred or is likely to occur, without needing to diagnose or resolve the problem.Ability to combine pieces of information to form general rules or conclusions (includes finding a relationship among seemingly unrelated events)Ability to switch efficiently between multiple tasks or information sources, such as spoken instructions, system alerts, or data inputs.Ability to organize data or actions in a defined sequence or structure based on specified rules or patterns (e.g., numerical, textual, visual, or mathematical sequences).Ability to recognize defined patternssuch as shapes, words, or signalseven when they are embedded within distracting or complex information.EducationRequired: Bachelor's degree in Computer Science, Engineering, Information Systems or related field and/or equivalent formal training ExperienceRequired: Intermediate level experience, fully functioning broad knowledge in:Cloud infrastructure, DataLakeETL experience ensuring source to target data integrityVarious filetypes (Delimited Text, Fixed Width, XML, JSON, Parque).ServiceBus, setting up ingress and egress within a subscription, or relevant AWS Cloud services administrative experience.Unit Depar