Data ingestion, at scale
Hatchet is built to support massively parallel workloads, often seen in document ingestion, image/video processing, or bulk file processing.
Pipelines as code
Every pipeline can be defined as a Hatchet DAG or a durable task. You can run hundreds of thousands of pipelines simultaneously and scale to hundreds of workers.
Fairness and priority for ingestion at scale
Hatchet’s concurrency control and priority features are built to help you run workloads at scale. You can prioritize user-submitted workloads over batch workloads and distribute work fairly between organizations, users, or tenants using Hatchet’s concurrency control features.
Concurrency keys ensure that resources are distributed fairly between users.
Keep data fresh
Hatchet supports event-based triggering and webhooks to ensure your data is always fresh. If data changes upstream, you can quickly sync it back to your data stores using Hatchet’s built-in features.
Run your ingestion pipelines on Hatchet. Highly parallelized, fair scheduling.
Start for free — no credit card required
Processing over 100 million tasks/day on Hatchet Cloud
Open-source and self-hostable