Senior Data Engineer (Scala/Spark, Databricks)

Responsibilities

• Develop and maintain code bases for ETL and ELT pipelines, large batch/micro-batch processing and streaming systems
• Build infrastructure for optimal extraction, transformation and loading of data using Spark, ADF or similar technologies
• Identify and implement internal process improvements, including automation, data optimizations and infrastructure redesign for scalability
• Design and implement data services solutions leveraging technologies such as Spring Boot, ReactJS or NoSQL
• Ensure governance of processes in delivery management and production adhering to the selected delivery model
• Serve as a single point of accountability for delivery-related matters, including escalations, upsells and ramp-downs
• Lead technical delivery to ensure sound architecture and compliance with quality standards
• Define and document stories with associated acceptance criteria for agile workflows
• Coordinate with stakeholders and teams across various disciplines to ensure seamless project execution
• Deliver projects following customer processes, methodologies and agile approaches

Languages