Lead Databricks Engineer

Responsibilities

• Lead architecture design and implementation of scalable solutions on Azure Databricks
• Define and enforce platform standards, ensuring compliance with data governance and security policies
• Build and optimize Databricks streaming workloads, including Structured Streaming and Delta Live Tables
• Collaborate with cross-functional teams to translate requirements into robust technical solutions
• Drive platform performance tuning, cost optimization and monitoring strategies for cloud workloads
• Provide leadership across the full engineering lifecycle, including solution delivery and production support
• Mentor and guide developers, establishing best practices for data engineering on Azure and Databricks
• Participate in technical decision-making and review designs for scalability and maintainability
• Implement observability for critical pipelines and maintain quality assurance standards
• Engage directly with stakeholders to ensure alignment on strategic platform initiatives

Languages