Editing Apache Airflow
Jump to navigation
Jump to search
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 3: | Line 3: | ||
* [[Cloud Composer]] | * [[Cloud Composer]] | ||
− | * [[Apache Airflow installation| | + | * [[Apache Airflow installation|installation]]: |
+ | ** PIP: | ||
+ | *** <code>[[pip3 install apache-airflow]]</code> | ||
+ | **** <code>[[pip install apache-airflow-providers-elasticsearch]]</code> | ||
+ | **** <code>pip3 install apache-airflow[celery]</code> | ||
+ | ** Homebrew: not available | ||
+ | ** [[Airflow configuration|Configuration]] | ||
+ | ** Kubernetes: | ||
+ | :::<code>[[helm repo add apache-airflow]] https://airflow.apache.org</code> | ||
+ | :::<code>[[helm upgrade --install]] airflow apache-airflow/airflow --namespace airflow --create-namespace</code> | ||
== Commands == | == Commands == | ||
* <code>[[airflow --help]]</code> | * <code>[[airflow --help]]</code> | ||
* <code>[[airflow db]]</code> | * <code>[[airflow db]]</code> | ||
− | |||
− | |||
− | |||
== Logs == | == Logs == | ||
* [[Started process]] | * [[Started process]] | ||
− | |||
− | |||
== Related == | == Related == | ||
* [[Directed acyclic graph (DAG)]] | * [[Directed acyclic graph (DAG)]] | ||
− | |||
* [[Airflow Scheduler]] | * [[Airflow Scheduler]] | ||
− | + | * [[Amazon Managed Workflows for Apache Airflow (MWAA)]] | |
− | |||
− | |||
− | * [[Amazon Managed Workflows for Apache Airflow (MWAA)]] | ||
* [[Apache Airflow providers]]: https://airflow.apache.org/docs/apache-airflow-providers/ | * [[Apache Airflow providers]]: https://airflow.apache.org/docs/apache-airflow-providers/ | ||
Line 32: | Line 32: | ||
port: "8126" | port: "8126" | ||
metricsets: [ '[[statsd]]' ] | metricsets: [ '[[statsd]]' ] | ||
− | |||
− | |||
== Activities == | == Activities == | ||
* Read https://www.astronomer.io/blog/7-common-errors-to-check-when-debugging-airflow-dag/ | * Read https://www.astronomer.io/blog/7-common-errors-to-check-when-debugging-airflow-dag/ | ||
− | |||
== See also == | == See also == | ||
Line 44: | Line 41: | ||
* {{airflow cmd}} | * {{airflow cmd}} | ||
* {{Airflow}} | * {{Airflow}} | ||
+ | * {{DAG}} | ||
+ | [[Category:Big data]] | ||
[[Category:Apache]] | [[Category:Apache]] | ||
[[Category:Airflow]] | [[Category:Airflow]] |
Advertising: