Senior Big Data System Engineer (Platform Engineer)

Responsibilities

• Operate and maintain core Global Data Platform components, including VM Servers, Kubernetes and Kafka, to ensure smooth system performance and functionality
• Manage data and analytics applications, such as Apache stack components, Dataiku, Collibra and other essential tools
• Automate infrastructure configurations, security components and CI/CD pipelines to drive efficiency and eliminate manual intervention in data pipelines
• Develop robust solutions to enhance platform resiliency, implement health checks, monitoring, alerting and self-recovery mechanisms for data operations
• Focus on improving data pipeline quality by addressing accuracy, timeliness and recency in ELT/ETL execution
• Embed Agile and DevSecOps best practices into delivery processes, ensuring iterative development and deployment of integrated solutions
• Collaborate with stakeholders like enterprise security, digital engineering and cloud operations to align on effective solution architectures
• Keep track of and evaluate emerging technologies across the Big Data ecosystem to deliver innovative features and capabilities

Languages