Senior Data Software Engineer/ Airflow, Snowflake, AI, dbt

Responsibilities

• Implement monitoring rules for data pipeline health, freshness, volume, run outcomes, and other agreed monitoring objectives
• Develop data processing and transformation logic for monitoring events and operational data
• Build automated Jira incident creation based on detected monitoring events
• Ensure incidents contain the required information, including component, region, DAG/job, run, timestamp, detecting check, error reference, and severity
• Support incident recurrence handling, stakeholder notification, and monitoring of incident status
• Develop and maintain the operator workspace/health view for monitoring data products and pipeline status
• Enable integration of monitoring data with Snowflake and other components of the solution
• Participate in testing monitoring rules and incident automation against real and historical failures
• Troubleshoot issues, improve monitoring logic, and support solution handover

Languages