Editing Apache Airflow

Jump to navigation Jump to search

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.

Latest revision Your text
Line 3: Line 3:
  
 
* [[Cloud Composer]]
 
* [[Cloud Composer]]
* [[Apache Airflow installation|Installation]]
+
* Installation:
 +
** PIP: <code>[[pip3 install apache-airflow]]</code>
 +
** Homebrew: not available
 +
** Kubernetes:
 +
:::<code>[[helm repo add apache-airflow]]</code>
 +
:::<code>[[helm upgrade --install]] airflow apache-airflow/airflow --namespace airflow --create-namespace</code>
  
 
== Commands ==
 
== Commands ==
* <code>[[airflow --help]]</code>
 
 
* <code>[[airflow db]]</code>
 
* <code>[[airflow db]]</code>
* <code>[[airflow webserver]]</code>
 
* <code>[[airflow standalone]]</code>
 
* <code>[[airflow version]]</code>
 
 
== Logs ==
 
* [[Started process]]
 
* [[Fluentd]] recommended for logs
 
* [[StatsD]] recommended for metrics to [[Prometheus]]
 
  
 
== Related ==
 
== Related ==
 
* [[Directed acyclic graph (DAG)]]
 
* [[Directed acyclic graph (DAG)]]
* [[Drawing DAGs]]
 
 
* [[Airflow Scheduler]]
 
* [[Airflow Scheduler]]
* [[Airflow Operators]]
+
* [[Amazon Managed Workflows for Apache Airflow (MWAA)]]
* [[Job scheduler]]
 
* [[Apache NiFi]]
 
* [[Amazon Managed Workflows for Apache Airflow (MWAA)]] (May 2021))
 
 
* [[Apache Airflow providers]]: https://airflow.apache.org/docs/apache-airflow-providers/
 
* [[Apache Airflow providers]]: https://airflow.apache.org/docs/apache-airflow-providers/
  
Line 32: Line 24:
 
   port: "8126"
 
   port: "8126"
 
   metricsets: [ '[[statsd]]' ]
 
   metricsets: [ '[[statsd]]' ]
* [[Apache airflow metrics]]
 
* [[Running Airflow in Docker]]
 
 
== Activities ==
 
* Read https://www.astronomer.io/blog/7-common-errors-to-check-when-debugging-airflow-dag/
 
* [[Datadog Airflow integration]]
 
  
 
== See also ==
 
== See also ==
 
* [[Astronomer]] and [[Astronomer Cloud]]
 
* [[Astronomer]] and [[Astronomer Cloud]]
 
* [[Cloud composer]] service on [[Google Cloud Platform]]
 
* [[Cloud composer]] service on [[Google Cloud Platform]]
* {{airflow cmd}}
 
 
* {{Airflow}}
 
* {{Airflow}}
 +
* {{DAG}}
  
 +
[[Category:Big data]]
 
[[Category:Apache]]
 
[[Category:Apache]]
 
[[Category:Airflow]]
 
[[Category:Airflow]]

Please note that all contributions to wikieduonline may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see Wikieduonline:Copyrights for details). Do not submit copyrighted work without permission!

Cancel Editing help (opens in new window)

Templates used on this page:

Advertising: