We are seeking a skilled Python Developer with Apache Airflow expertise to support and optimize workflow orchestration across enterprise applications. This role will focus on building efficient data pipelines, improving existing workflows, and collaborating with application teams to enhance system performance and reliability.
Key Responsibilities
- Develop and maintain Airflow DAGs for workflow orchestration and automation
- Optimize existing workflows by identifying inefficiencies and implementing improvements
- Support application teams in integrating and managing Airflow-based pipelines
- Participate in Airflow cluster administration, monitoring, and troubleshooting
- Implement dynamic DAG generation and ensure scalable pipeline design
- Collaborate with DevOps teams to support CI/CD processes and deployment workflows
- Ensure reliability, performance, and maintainability of data pipelines
Required Skills & Qualifications
- Strong experience in Python development
- Hands-on expertise with Apache Airflow, including DAG creation and scheduling
- Solid understanding of Airflow core concepts (operators, schedulers, executors, etc.)
- Experience with dynamic DAG generation and workflow optimization
- Familiarity with CI/CD processes (basic understanding required)
- Strong troubleshooting and problem-solving skills
- Ability to work collaboratively with cross-functional teams