All vacancies
Senior/Lead Data Software Engineer (Python, Spark, Azure)
EPAM Systems
Remote · PolandSalary not disclosedfull-timeEPAM Systems Careers (remote abroad)
We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready platform that enhances portfolio model development and deployment with advanced data governance and AI capabilities. You will play a key role in migrating from an IaaS Big Data platform to Azure-native Databricks, optimizing data workflows and improving data quality.
Responsibilities
- Migrate and optimize over 500 data jobs using Azure Databricks optimization techniques
- Manage and process 12 TB of data efficiently across platforms
- Tune machine learning models for Azure environments using Java Spark and Delta tables
- Update and maintain libraries to address security vulnerabilities
- Develop and maintain ETL/ELT pipelines using PySpark and related technologies
- Collaborate with cross-functional teams to integrate GenAI capabilities into data workflows
- Monitor data quality and implement improvements to ensure accuracy and reliability
- Automate deployment and operational tasks using Terraform and GitLab CI/CD
- Support data governance initiatives to comply with regulatory standards
- Troubleshoot and resolve performance issues in data processing systems
Languages
- Work format
- Remote
- Seniority
- Lead
- Posted
- 29 Sept 2026
- Last verified
- In the last 5 days
Similar roles
- Software EngineerSoftShark · Armenia · On-site
- Software Engineer (Internal Tools & HR Automation)Salmon · Remote · Armenia
- Java Developer(Remote)TechBiz Global · Remote · Armenia
- Software Engineer - BranchingSupabase · Remote · worldwide
- FrontEnd EngineerTruv · Remote · Armenia
- Senior WordPress Engineer (Freelance)XWP · Remote · worldwide, UTC+4 accepted