Staff Software Engineer - Ingestion Platform

Responsibilities

• As a Staff Engineer, you will lead the development and evolution of Reddit’s Ingestion Platform.
• Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, correctness, and cost efficiency.
• Own the architecture and evolution of the platform’s control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations.
• Expand the platform beyond Kafka-to-BigQuery by helping deliver production-ready paths to S3/GCS and Apache Iceberg, as well as transformations, deduplication, dead-letter queues, and other reusable capabilities.
• Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores, while keeping the platform modular and easy to extend.
• Improve the self-service experience for platform users through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting.
• Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering with teams such as Ads Data Platform and ML Indexing to make migrations safe, incremental, and low-touch.
• Establish strong reliability, security, and operational practices for pipelines running across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response.
• Identify gaps in the platform’s architecture and product experience, and lead redesigns that improve developer velocity and enable Reddit’s continued growth.
• Work collaboratively with engineers and stakeholders across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions.

Languages