To Nha Notes | Technology blog posts

Code examples for Amazon Managed Workflows for Apache Airflow (MWAA)

To Nha Notes | Jan. 31, 2023, 1:23 p.m.

This guide contains code samples, including DAGs and custom plugins, that you can use on an Amazon Managed Workflows for Apache Airflow (MWAA) environment. For more examples of using Apache Airflow with AWS services, see the example_dags directory in the Apache Airflow GitHub repository.

Samples

Using a DAG to import variables in the CLI
Creating an SSH connection using the SSHOperator
Using a secret key in AWS Secrets Manager for an Apache Airflow Snowflake connection
Using a DAG to write custom metrics in CloudWatch
Aurora PostgreSQL database cleanup on an Amazon MWAA environment
Exporting environment metadata to CSV files on Amazon S3
Using a secret key in AWS Secrets Manager for an Apache Airflow variable
Using a secret key in AWS Secrets Manager for an Apache Airflow connection
Creating a custom plugin with Oracle
Creating a custom plugin that generates runtime environment variables
Changing a DAG's timezone on Amazon MWAA
Refreshing a CodeArtifact token
Creating a custom plugin with Apache Hive and Hadoop
Creating a custom plugin for Apache Airflow PythonVirtualenvOperator
Invoking DAGs with a Lambda function
Invoking DAGs in different Amazon MWAA environments
Using Amazon MWAA with Amazon RDS for Microsoft SQL Server
Using Amazon MWAA with Amazon EMR
Using Amazon MWAA with Amazon EKS
Connecting to Amazon ECS using the ECSOperator
Using dbt with Amazon MWAA
AWS blogs and tutorials

References

https://docs.aws.amazon.com/mwaa/latest/userguide/sample-code.html

Posts

Technical AI Startup Work Learning Tools Books Kinh doanh Đọc sách Làm bánh Cuộc sống Tài chính Bất động sản Đầu tư Nice words