Apache Airflow
Python-based DAG orchestration for data and ML pipelines at scale, with task scheduling, retries, monitoring, and extensibility. Suitable for data teams, integrable with lakeFS for versioning.
Visit Apache Airflow →data pipeline scheduling monitoring extensibility
Want to know if Apache Airflow fits your workflow?
Audit My AI ToolkitSimilar Tools in MLOps
Amazon SageMaker PipelinesManaged ML-native orchestration on AWS with per-step isolation, GPU support, and minimal ops overhead. Recommended fo...
Managed Kubeflow-based orchestration for end-to-end ML/AI workflows on Google Cloud, with metadata tracking, monitori...
ML-native pipeline orchestration on Kubernetes with container isolation, GPU scheduling, artifact tracking, and compl...
Open-source workflow orchestration tool for end-to-end ML pipelines, featuring Prefect Orion UI for local hosting and...