Senior Data Software Engineer, Spark, Java, Scala

Responsibilities

• Write new data pipelines and jobs to produce new outputs (datasets) in scope of new features development Adopt existing data pipelines to integrate with new org-wide platforms, tools, services, and languages Fix bugs in code and correct data caused by incorrect logic or implementation Perform ad-hoc data exploration,…
• Monitor and troubleshoot production issues with pipelines owned by the team
• Develop and adopt data quality checks to monitor data issues in the systems Scope and plan new development, including assessing level of effort and providing timelines
• Maintain tickets hygiene in Radar (ticketing system) Evolve jobs, apps, and systems to a better state across all aspects: code quality, complexity, maintainability, and documentation
• Communicate with other data engineers in the team, peer teams (QA, UAT, Platform, etc), project managers, and engineering managers on status, blockers, estimates, and timelines

Languages