Modern Data Orchestration, powered by Apache Airflow
Astronomer is the author of a set of skills that help AI agents work with Apache Airflow, covering local environment management with the Astro CLI, DAG failure diagnosis and debugging, data freshness checks, and running dbt Fusion projects through Astronomer Cosmos on Snowflake and Databricks. The skills also extend Airflow beyond Python, with guidance on implementing task logic in Go and Java through the language SDKs and configuring Airflow to route queues to native-language coordinators. Taken together, Astronomer's skills stand out for covering both the day-to-day operation of Airflow across its 2.x and 3.x versions and the multi-language task execution model.
Agents
35 skills · 458 stars · Apache-2.0
Airflow Queries, manages, and troubleshoots Apache Airflow using the `af` CLI.
Airflow Adapter Airflow adapter pattern for v2/v3 API compatibility.
Airflow Hitl Builds human-in-the-loop (HITL) Airflow workflows - approval gates, form input, and human-driven…
Airflow Plugins Builds Airflow 3.1+ plugins that embed FastAPI apps, custom UI pages, React components, middlewar…
Airflow State Store Persists task and asset state across retries and DAG runs using Airflow 3.3's AIP-103 key/value s…
Analyzing Data Queries the data warehouse with SQL and answers business questions about data.
Annotating Task Lineage Annotate Airflow tasks with data lineage using inlets and outlets.
Authoring Dags Workflow and best practices for writing Apache Airflow DAGs.
Authoring Go Sdk Tasks Writes Airflow task logic in Go using the Airflow Go SDK.
Authoring Java Sdk Tasks Writes Airflow task logic in Java, Kotlin, or any JVM language using the Airflow Java SDK.
Authoring Language Sdk Tasks The language-neutral foundation for Airflow language SDKs — implement task logic in a non-Python…
Blueprint Define reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML.
Checking Freshness Quick data freshness check.
Configuring Airflow Language Sdks Configures Airflow to run language SDK tasks (Java, Go, and future native SDKs) — register a coor…
Cosmos Dbt Core Turns a dbt Core project into an Airflow DAG/TaskGroup using Astronomer Cosmos.
Cosmos Dbt Fusion Run a dbt Fusion project with Astronomer Cosmos.
Creating Openlineage Extractors Create custom OpenLineage extractors for Airflow operators.
Dag Factory Authors Apache Airflow DAGs declaratively from dag-factory YAML configs.
Debugging Dags Comprehensive DAG failure diagnosis and root-cause analysis with structured investigation and pr…
Delegating To Otto Drives Astronomer's Otto agent (`astro otto`) as a delegated sub-agent for Airflow, dbt, and data…
Deploying Airflow Deploys Airflow DAGs and projects.
Deploying Go Sdk Bundles Builds, packs, and deploys compiled Airflow Go SDK bundles so the ExecutableCoordinator can run t…
Deploying Java Sdk Bundles Builds and deploys compiled Airflow Java SDK bundles so workers can run them.
Managing Astro Deployments Manage Astronomer production deployments with Astro CLI.
Managing Astro Local Env Manage local Airflow environment with Astro CLI (Docker and standalone modes).
Migrating Ai Sdk To Common Ai Migrates Airflow projects from airflow-ai-sdk to apache-airflow-providers-common-ai 0.4.0+.
Migrating Airflow 2 To 3 Guide for migrating Apache Airflow 2.x projects to Airflow 3.x.
Migrating Dagster To Airflow Guide for migrating Dagster projects to Apache Airflow 3 on Astro.
Profiling Tables Deep-dive data profiling for a specific table.
Setting Up Astro Project Initialize and configure Astro/Airflow projects.
Testing Dags Complex DAG testing workflows with debugging and fixing cycles.
Tracing Downstream Lineage Trace downstream data lineage and impact analysis.
Tracing Upstream Lineage Trace upstream data lineage.
Troubleshooting Astro Deployments Troubleshoot Astronomer production deployments with Astro CLI.
Warehouse Init Initialize warehouse schema discovery.