Apache Airflow Engineer (Hyderabad)

Role Overview Location: Hyderabad Exp-5 +years Contract We are seeking a skilled Apache Airflow Engineer to design, develop, and maintain scalable workflow orchestration pipelines while ensuring alignment with institutional compliance. This role combines solid data engineering expertise with a deep understanding of financial compliance domain Key Responsibilities Airflow & Data Engineering - Design, develop, and manage Apache Airflow DAGs for scheduling, monitoring, and orchestrating complex data pipelines. - Build scalable ETL/ELT workflows integrating data from multiple sources (databases, APIs, cloud platforms). - Optimize Airflow performance, manage task dependencies, retries, SLA monitoring, and alerting. - Implement CI/CD pipelines for DAG deployment and version control (Git-based workflows). - Troubleshoot production issues and ensure high availability of workflows. - Integrate Airflow with cloud platforms (AWS, Azure, GCP) and services such as S3, Ensure business continuity and disaster recovery planning for data workflows. - Strong hands-on experience with Apache Airflow (DAG development, scheduling, monitoring). - Proficiency in Python (core requirement for Airflow). - Experience with SQL and relational/non-relational databases. - Familiarity with cloud platforms (AWS/Azure/GCP). Work Location: In person .