Sr DataOps Engineer (R14334)

Responsibilities

• Your day-to-day
• You’ll administer and support Databricks workspaces, cluster policies, compute configurations, jobs, workflows, libraries, service principals, permissions, and platform integrations.
• You’ll support Unity Catalog, including access governance, catalog and schema permissions, and secure data sharing.
• You’ll monitor and troubleshoot Delta Live Tables, Spark jobs, Delta Lake workloads, and data pipelines, including failures, performance issues, recovery, and data-quality concerns.
• You’ll maintain secure and reliable integrations between Databricks and AWS services, including S3, IAM, networking, VPC connectivity, and external data sources.
• You’ll support AWS infrastructure used by the data platform, including EC2, VPC, IAM, security groups, networking, patching, and operational access.
• You’ll support MariaDB/MySQL and MongoDB environments, including availability, monitoring, connectivity, backup coordination, performance troubleshooting, and recovery.
• You’ll build and maintain monitoring, dashboards, logs, metrics, and alerts across Databricks, pipelines, databases, infrastructure, and integrations.
• You’ll participate in on-call support and lead investigation, mitigation, recovery, communication, and root-cause analysis for production incidents.
• You’ll build and maintain infrastructure and automation using Terraform, Terraform Enterprise, Git, GitHub Actions, CI/CD pipelines, and scripting.

Languages