Lead Data Engineer

Responsibilities

• Lead the design and architecture of cloud-native analytical solutions using Big Data and NoSQL technologies
• Oversee the development and optimization of scalable data pipelines in Databricks with PySpark on Azure
• Own the strategy for building and maintaining data lakes and warehouses, ensuring reliability, performance, and scalability
• Define and implement ETL/ELT workflows and best practices for data collection, cleaning, and structuring
• Establish and enforce data quality, lineage, and monitoring frameworks across the team
• Collaborate closely with ML, analytics, and business teams to deliver production-ready datasets and solutions
• Conduct and lead code reviews, setting technical standards and fostering best practices
• Mentor and coach data engineers, cultivating a high-performance and collaborative team culture
• Champion CI/CD methodologies in data engineering workflows using tools like Jenkins or GitLab CI/CD
• Drive requirements gathering and solution alignment with architects, technical leads, and cross-functional teams

Languages