Senior Data Engineer - EDA Datacenter Analytics and Observability

Responsibilities

• Design, build, and maintain analytics-focused data pipelines that ingest, transform, and curate observability data from EDA datacenters
• Develop reliable ingestion pipelines for metrics, logs, traces, and hardware health telemetry generated by large-scale CPU and GPU clusters
• Partner with observability engineers to integrate data from tools such as Prometheus, Grafana, Elastic/OpenSearch, and Spark-based platforms into unified analytical datasets
• Model and organize data to support exploratory analysis, reliability modeling, forecasting, and long-term trend analysis
• Build and optimize batch and streaming workflows that support both near-real-time analytics and historical analysis
• Implement data quality checks, validation frameworks, and monitoring to ensure analytical accuracy and consistency
• Define data retention, aggregation, and enrichment strategies that balance analysis needs, system performance, and storage costs
• Enable self-service analytics by improving data discoverability, documentation, and usability
• Collaborate with data scientists and analysts to understand analytical requirements and evolve datasets to support new models and insights
• Continuously improve pipeline scalability, reliability, and performance as datacenter footprint and workload complexity grow

Languages