Source description
About the role
ROLE: Batch Scheduling Engineer (Airflow Migration Automation) LOCATION: IND Chennai TERMS: Local Scope of Role: We are seeking an experienced Batch Scheduling Automation Engineer to support an enterprise-wide migration from legacy schedulers (e.g., Control-M / BMC / Cron-based workloads) to Apache Airflow based orchestration platform. The role involves workflow analysis, DAG development, Python automation, API integrations, and operational support across Linux and Windows environments. The engineer will work closely with application teams, infrastructure teams, and platform engineering to onboard applications onto the current orchestration platform while maintaining production stability. This is a hands-on technical role requiring strong troubleshooting, scripting, and platform integration skills. Key Responsibilities - Analyse existing batch workloads from legacy schedulers (Control-M / BMC / Cron) - Design Airflow DAGs replicating enterprise scheduling logic: - Dependencies - Calendars / holidays - Cyclic schedules - File triggers - Conditional workflows - Convert jobs/scripts into standardized Airflow-compatible workflows - Develop reusable operators/plugins for enterprise integrations - Implement job parameterization, rerun, hold/release logic - Build scheduling wrappers for legacy applications during transition phase Python Development Automation - Develop production-grade Python code for: - DAG development - Operators Sensors - REST API integrations - Job automation frameworks - Write modular and reusable libraries for job execution and monitoring - Handle exception management, retries, logging, and alerting logic - Integrate Airflow with external systems using APIs (e.g., Kong Gateway / Service APIs) API Integration (minimum knowledge) - Work with API gateways (Kong or similar) for job triggering and monitoring - Implement REST-based job execution - Integrate schedulers with: - Ticketing tools - Monitoring platforms - External application APIs - Secure API communication using authentication tokens and certificates Production Support Troubleshooting - Investigate batch failures, delays, and performance issues - Perform root cause analysis across: - Airflow platform - OS level - Network/API layer - Application scripts - Support high-availability scheduling environments - Handle incident, problem, and change management activities Do 1. Provide tool design, development and deployment support for the project delivery a. Interact with the internal project or client to understand the project requirement from a tool perspective b. Design the solution keeping in mind the tool requirements, current tools available as well as details on licenses required etc. c. Provide budget and timeline estimates for the tool development/ deployment as required d. For any new tool development, identify sources for development (internal or 3rd party) and work with the project managers on the development of the tool keeping in mind the production rollout timelines e. Conduct commercial discussions with the 3rd party vendors for licenses or tool development f. Conduct appropriate testing to ensure error free deployment of the tool on the project g. Ensure deployment of tool on time and within the estimated budget Mandatory Skills: BMC Control M . Experience: 5-8 Years . .
More at Wipro