Senior/Lead Data Engineer [Scala]

Responsibilities

• Architect and maintain scalable ETL/ELT pipelines for batch, micro-batch, and streaming data processing systems
• Build frameworks for optimal extraction, transformation, and delivery of data using technologies like ADF, Spark, and Kafka
• Identify and implement process improvements, automating workflows and optimizing data infrastructure for efficiency and scalability
• Design and implement innovative data service solutions leveraging Spring Boot, ReactJS, or other UI and API-related technologies
• Ensure governance and adherence to delivery management processes for seamless operations
• Act as a single point of responsibility for all delivery-related concerns, including client escalations, contractual changes, and team resource management
• Provide technical leadership, ensuring solutions align with high-quality standards and future-proof architecture planning
• Write user stories and acceptance criteria for agile and scrum workflows
• Collaborate with cross-functional teams and stakeholders to align goals and execution
• Ensure compliance with delivery methodologies and industry best practices, particularly agile approaches

Languages