Skip to content
Kitbay

authoring-mwaa-workflow

Apache-2.0Updated on Nov 11, 20263,464GitHub stars

This aws-data-analytics skill writes and deploys workflows for Amazon Managed Workflows for Apache Airflow (MWAA).

What the skill teaches

This aws-data-analytics skill writes and deploys workflows for Amazon Managed Workflows for Apache Airflow (MWAA). For provisioned environments it writes Python Airflow DAGs and uploads them to S3; for MWAA Serverless it writes YAML workflow files and creates or updates the workflow. It covers choosing operators, timeouts, retries, schedules, failure alerts and idempotent tasks, checks Serverless schema rules, can create an environment when the user approves, redeploys fixes, and can then hand over to the testing-mwaa-workflow skill. Converting DAGs between provisioned and serverless is out of scope.

Capabilities

  • Write Airflow DAGs for MWAA
  • Write YAML workflows for MWAA Serverless
  • Deploy workflows to MWAA
  • Create an MWAA environment when approved