Job Description
|
ROLE: |
Batch Scheduling Engineer (Airflow Migration & Automation) |
|
LOCATION: |
IND – Chennai |
|
TERMS: |
Local |
Scope of Role:
We are seeking an experienced Batch Scheduling & Automation Engineer to support an enterprise-wide migration from legacy schedulers (e.g., Control-M / BMC / Cron-based workloads) to Apache Airflow based orchestration platform.
The role involves workflow analysis, DAG development, Python automation, API integrations, and operational support across Linux and Windows environments. The engineer will work closely with application teams, infrastructure teams, and platform engineering to onboard applications onto the new orchestration platform while maintaining production stability.
This is a hands-on technical role requiring strong troubleshooting, scripting, and platform integration skills.
Key Responsibilities
- Analyse existing batch workloads from legacy schedulers (Control-M / BMC / Cron)
- Design Airflow DAGs replicating enterprise scheduling logic:
- Dependencies
- Calendars / holidays
- Cyclic schedules
- File triggers
- Conditional workflows
- Convert jobs/scripts into standardized Airflow-compatible workflows
- Develop reusable operators/plugins for enterprise integrations
- Implement job parameterization, rerun, hold/release logic
- Build scheduling wrappers for legacy applications during transition phase
Python Development & Automation
- Develop production-grade Python code for:
- DAG development
- Operators & Sensors
- REST API integrations
- Job automation frameworks
- Write modular and reusable libraries for job execution and monitoring
- Handle exception management, retries, logging, and alerting logic
- Integrate Airflow with external systems using APIs (e.g., Kong Gateway / Service APIs)
API & Integration (minimum knowledge)
- Work with API gateways (Kong or similar) for job triggering and monitoring
- Implement REST-based job execution
- Integrate schedulers with:
- Ticketing tools
- Monitoring platforms
- External application APIs
- Secure API communication using authentication tokens and certificates
Production Support & Troubleshooting
- Investigate batch failures, delays, and performance issues
- Perform root cause analysis across:
- Airflow platform
- OS level
- Network/API layer
- Application scripts
- Support high-availability scheduling environments
- Handle incident, problem, and change management activities
͏
Do
1. Provide tool design, development and deployment support for the project delivery
a. Interact with the internal project or client to understand the project requirement from a tool perspective
b. Design the solution keeping in mind the tool requirements, current tools available as well as details on licenses required etc.
c. Provide budget and timeline estimates for the tool development/ deployment as required
d. For any new tool development, identify sources for development (internal or 3rd party) and work with the project managers on the development of the tool keeping in mind the production rollout timelines
e. Conduct commercial discussions with the 3rd party vendors for licenses or tool development
f. Conduct appropriate testing to ensure error free deployment of the tool on the project
g. Ensure deployment of tool on time and within the estimated budget
͏
Deliver
| No. | Performance Parameter | Measure |
| 1. | Tool Development and deployment | Quality of solution Timely development and within budget Timely deployment of tool Error free deployment |
͏
͏
Experience: 5-8 Years .
Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.