Software Engineer - Data Pipelines

4+ years building production data pipelines at scale

Solid Python 3.10+ chops (Pydantic, async, decorators).

Apache Airflow - DAG authoring, MWAA or self-hosted production experience

PySpark - job authoring, optimization, EMR or Databricks

AWS knowledge (S3, SQS/SNS, EMR).

Data quality tooling: Great Expectations, Monte Carlo, or equivalent

You'll own the whole lifecycle of data pipelines running in 15+ regions, building them from start to finish.

You'll write big, distributed processing jobs to handle massive datasets.

You'll build and maintain pipelines that feed our product's access layer—think threat intelligence, assets, and detections.

Quality is huge: you’ll build frameworks to check data health, run conditional checks, and keep everything observable

You’ll implement distributed tracing across all your pipelines.