Title: Python + Apache Airflow Developer
Must Have: Python and Apache Airflow in Data Engineering, preferably 5+ yr exp
Position Overview:
We are seeking a skilled Python and Airflow Developer with a strong data engineering background to join our team.
The ideal candidate will have extensive experience in developing and managing data workflows using Python and Apache Airflow, along with a solid understanding of SQL and NoSQL databases.
Key Responsibilities:
Design, develop, and maintain data pipelines and workflows using Apache Airflow and Python.
Collaborate with business managers and analysts to understand data requirements and translate them into scalable and efficient data models.
Optimize and maintain existing data workflows to ensure optimal performance and reliability.
Integrate and manage various SQL and NoSQL databases to support business intelligence and analytics.
Ensure data quality, consistency, and security across all data pipelines.
Monitor and troubleshoot data pipeline issues and implement appropriate solutions.
Required Qualifications:
Proven experience in Python programming with a focus on data engineering.
Hands-on experience with Apache Airflow for orchestrating complex data workflows.
Strong understanding of SQL and experience with various SQL databases (e.g., PostgreSQL, Snowflake).
Familiarity with NoSQL databases (e.g., MongoDB, ElasticSearch).
Experience in data modeling, ETL processes, and data warehouse design.