Senior Data Engineer - Worldwide, Part Time

Responsibilities

• Design, build, and maintain ETL/ELT pipelines that process large-scale data efficiently and reliably.
• Develop and manage cloud-native data pipelines using AWS Glue, Python, and SQL.
• Orchestrate data workflows and stateful jobs using AWS Step Functions for robust process management and automation.
• Store and manage large datasets in Amazon S3 with efficient partitioning, data formats (e.g., Parquet), and access control strategies.
• Design and optimize relational data structures in PostgreSQL, ensuring data accuracy and performance.
• Implement data quality monitoring, logging, and alerting within all pipeline processes.
• Collaborate with cross-functional teams to define data requirements and ensure consistency, availability, and accessibility.
• Participate in code reviews, architecture discussions, and continuous improvement of engineering best practices.
• Ensure adherence to data security, privacy, and governance standards.

Languages