Senior Data Engineer

Responsibilities

• Design, build and optimize scalable Python-based ETL/ELT pipelines using frameworks such as pandas or Polars
• Orchestrate data pipelines using Dagster, Airflow or similar tools
• Develop efficient data ingestion pipelines for batch, incremental and streaming scenarios
• Integrate with internal and external APIs ensuring robust authentication, error handling and data quality
• Implement best-in-class data models including dimensional modelling and domain-driven structures
• Manage application lifecycle and reduce architecture debt
• Deploy, operate and monitor data pipelines using Docker, Kubernetes and GitLab
• Develop and maintain CI/CD pipelines for data workflows and infrastructure components
• Collaborate with data scientists, software engineers and platform teams to enhance data services and deployment processes
• Support troubleshooting, incident response and participate in architecture discussions

Languages