ASF：Apache 軟體基金會¶

Airflow 支援由 Apache 軟體基金會建立的各種軟體。

軟體¶

這些整合讓您可以在由 Apache 軟體基金會開發的軟體中執行各種操作。

Apache Beam¶

運算子: airflow.providers.apache.beam.operators.beam.
Hooks: airflow.providers.apache.beam.hooks.beam.
指南: Apache Beam 運算子.
供應商: apache-airflow-providers-apache-beam
產品文件: Apache Beam

Apache Cassandra¶

Hooks: airflow.providers.apache.cassandra.hooks.cassandra.
感測器: airflow.providers.apache.cassandra.sensors.record, airflow.providers.apache.cassandra.sensors.table。
指南: Apache Cassandra 運算子.
供應商: apache-airflow-providers-apache-cassandra
產品文件: Apache Cassandra

Apache Drill¶

Hooks: airflow.providers.apache.drill.hooks.drill.
指南: 透過 SQLExecuteQueryOperator 連接至 Apache Drill.
供應商: apache-airflow-providers-apache-drill
產品文件: Apache Drill

Apache Druid¶

運算子: airflow.providers.apache.druid.operators.druid.
Hooks: airflow.providers.apache.druid.hooks.druid.
指南: Apache Druid 運算子.
供應商: apache-airflow-providers-apache-druid
產品文件: Apache Druid

Apache Flink¶

運算子: airflow.providers.apache.flink.operators.flink_kubernetes.
感測器: airflow.providers.apache.flink.sensors.flink_kubernetes.
指南: Apache Flink 運算子.
供應商: apache-airflow-providers-apache-flink
產品文件: Apache Flink

Apache Hive¶

運算子: airflow.providers.apache.hive.operators.hive, airflow.providers.apache.hive.operators.hive_stats。
Hooks: airflow.providers.apache.hive.hooks.hive.
感測器: airflow.providers.apache.hive.sensors.hive_partition, airflow.providers.apache.hive.sensors.metastore_partition, airflow.providers.apache.hive.sensors.named_hive_partition。
指南: Apache Hive 運算子.
供應商: apache-airflow-providers-apache-hive
產品文件: Apache Hive

Apache Impala¶

Hooks: airflow.providers.apache.impala.hooks.impala.
供應商: apache-airflow-providers-apache-impala
產品文件: Apache Impala

Apache Kafka¶

運算子: airflow.providers.apache.kafka.operators.consume, airflow.providers.apache.kafka.operators.produce。
Hooks: airflow.providers.apache.kafka.hooks.base, airflow.providers.apache.kafka.hooks.client, airflow.providers.apache.kafka.hooks.consume, airflow.providers.apache.kafka.hooks.produce。
感測器: airflow.providers.apache.kafka.sensors.kafka.
供應商: apache-airflow-providers-apache-kafka
產品文件: Apache Kafka

Apache Kylin¶

運算子: airflow.providers.apache.kylin.operators.kylin_cube.
Hooks: airflow.providers.apache.kylin.hooks.kylin.
供應商: apache-airflow-providers-apache-kylin
產品文件: Apache Kylin

Apache Livy¶

運算子: airflow.providers.apache.livy.operators.livy.
Hooks: airflow.providers.apache.livy.hooks.livy.
感測器: airflow.providers.apache.livy.sensors.livy.
指南: Apache Livy 運算子.
供應商: apache-airflow-providers-apache-livy
產品文件: Apache Livy

Apache Pig¶

運算子: airflow.providers.apache.pig.operators.pig.
Hooks: airflow.providers.apache.pig.hooks.pig.
指南: Apache Pig 運算子.
供應商: apache-airflow-providers-apache-pig
產品文件: Apache Pig

Apache Pinot¶

Hooks: airflow.providers.apache.pinot.hooks.pinot.
指南: Apache Pinot Hooks.
供應商: apache-airflow-providers-apache-pinot
產品文件: Apache Pinot

Apache Spark¶

運算子: airflow.providers.apache.spark.operators.spark_jdbc, airflow.providers.apache.spark.operators.spark_sql, airflow.providers.apache.spark.operators.spark_submit。
Hooks: airflow.providers.apache.spark.hooks.spark_connect, airflow.providers.apache.spark.hooks.spark_jdbc, airflow.providers.apache.spark.hooks.spark_jdbc_script, airflow.providers.apache.spark.hooks.spark_sql, airflow.providers.apache.spark.hooks.spark_submit。
指南: Apache Spark 運算子.
供應商: apache-airflow-providers-apache-spark
產品文件: Apache Spark

標準¶

運算子: airflow.providers.standard.operators.datetime, airflow.providers.standard.operators.weekday, airflow.providers.standard.operators.bash, airflow.providers.standard.operators.python, airflow.providers.standard.operators.generic_transfer, airflow.providers.standard.operators.trigger_dagrun, airflow.providers.standard.operators.latest_only。
Hooks: airflow.providers.standard.hooks.filesystem, airflow.providers.standard.hooks.package_index, airflow.providers.standard.hooks.subprocess。
感測器: airflow.providers.standard.sensors.date_time, airflow.providers.standard.sensors.time_delta, airflow.providers.standard.sensors.time, airflow.providers.standard.sensors.weekday, airflow.providers.standard.sensors.bash, airflow.providers.standard.sensors.python, airflow.providers.standard.sensors.filesystem, airflow.providers.standard.sensors.external_task。
指南: BashOperator, PythonOperator, BranchDateTimeOperator。
供應商: apache-airflow-providers-standard
產品文件: 標準

WebHDFS¶

Hooks: airflow.providers.apache.hdfs.hooks.webhdfs.
感測器: airflow.providers.apache.hdfs.sensors.web_hdfs.
指南: WebHDFS 運算子.
供應商: apache-airflow-providers-apache-hdfs
產品文件: WebHDFS

傳輸¶

這些整合讓您可以從/向由 Apache 軟體基金會開發的軟體複製資料。

Apache Hive 至 Amazon DynamoDB¶

來源產品文件: Apache Hive
目標產品文件: Amazon DynamoDB
運算子指南: Apache Hive 至 Amazon DynamoDB
Python API: airflow.providers.amazon.aws.transfers.hive_to_dynamodb
供應商: apache-airflow-providers-amazon

Apache Hive 至 Apache Druid¶

來源產品文件: Apache Hive
目標產品文件: Apache Druid
Python API: airflow.providers.apache.druid.transfers.hive_to_druid
供應商: apache-airflow-providers-apache-druid

Vertica 至 Apache Hive¶

來源產品文件: Vertica
目標產品文件: Apache Hive
Python API: airflow.providers.apache.hive.transfers.vertica_to_hive
供應商: apache-airflow-providers-apache-hive

Apache Hive 至 MySQL¶

來源產品文件: Apache Hive
目標產品文件: MySQL
Python API: airflow.providers.apache.hive.transfers.hive_to_mysql
供應商: apache-airflow-providers-apache-hive

Apache Hive 至 Samba¶

來源產品文件: Apache Hive
目標產品文件: Samba
Python API: airflow.providers.apache.hive.transfers.hive_to_samba
供應商: apache-airflow-providers-apache-hive

Amazon Simple Storage Service (S3) 至 Apache Hive¶

來源產品文件: Amazon Simple Storage Service (S3)
目標產品文件: Apache Hive
Python API: airflow.providers.apache.hive.transfers.s3_to_hive
供應商: apache-airflow-providers-apache-hive

MySQL 至 Apache Hive¶

來源產品文件: MySQL
目標產品文件: Apache Hive
Python API: airflow.providers.apache.hive.transfers.mysql_to_hive
供應商: apache-airflow-providers-apache-hive

Microsoft SQL Server (MSSQL) 至 Apache Hive¶

來源產品文件: Microsoft SQL Server (MSSQL)
目標產品文件: Apache Hive
Python API: airflow.providers.apache.hive.transfers.mssql_to_hive
供應商: apache-airflow-providers-apache-hive

Apache Cassandra 至 Google Cloud Storage (GCS)¶

來源產品文件: Apache Cassandra
目標產品文件: Google Cloud Storage (GCS)
Python API: airflow.providers.google.cloud.transfers.cassandra_to_gcs
供應商: apache-airflow-providers-google

這個條目有幫助嗎？