Google¶

Airflow 支援 Google 服務。

所有 Hook 皆基於 airflow.providers.google.common.hooks.base_google.GoogleBaseHook。部分整合也使用 airflow.providers.google.common.hooks.discovery_api。

請參閱 Google Cloud 連線類型文件，以設定與 Google 服務的連線。

Google Cloud¶

Airflow 廣泛支援 Google Cloud。

注意

您可以透過分析 Google Cloud 範例 DAG 的原始碼，學習如何使用 Google Cloud 整合

服務¶

這些整合讓您可以在 Google Cloud 內執行各種操作。

傳輸¶

這些整合讓您可以從 Google Cloud 複製資料到 Google Cloud 或從 Google Cloud 複製資料。

Google Cloud Storage (GCS) 至 Amazon Simple Storage Service (S3)¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Amazon Simple Storage Service (S3)
運算子指南: Google Cloud Storage 至 Amazon S3 傳輸運算子
Python API: airflow.providers.amazon.aws.transfers.gcs_to_s3
供應商: apache-airflow-providers-amazon

Amazon Glacier 至 Google Cloud Storage (GCS)¶

來源產品文件: Amazon Glacier
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Amazon S3 Glacier 至 GCS
Python API: airflow.providers.amazon.aws.transfers.glacier_to_gcs
供應商: apache-airflow-providers-amazon

Presto 至 Google Cloud Storage (GCS)¶

來源產品文件: Presto
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Presto 至 Google Cloud Storage 傳輸運算子
Python API: airflow.providers.google.cloud.transfers.presto_to_gcs
供應商: apache-airflow-providers-google

Trino 至 Google Cloud Storage (GCS)¶

來源產品文件: Trino
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Trino 至 Google Cloud Storage 傳輸運算子
Python API: airflow.providers.google.cloud.transfers.trino_to_gcs
供應商: apache-airflow-providers-google

通用 SQL 至 Google Cloud Storage (GCS)¶

來源產品文件: 通用 SQL
目標產品文件: Google Cloud Storage (GCS)
Python API: airflow.providers.google.cloud.transfers.sql_to_gcs
供應商: apache-airflow-providers-google

Google Cloud Storage (GCS) 至 Google Drive¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Google Drive
運算子指南: Google Cloud Storage 至 Google Drive 傳輸運算子
Python API: airflow.providers.google.suite.transfers.gcs_to_gdrive
供應商: apache-airflow-providers-google

Google Drive 至 Google Cloud Storage (GCS)¶

來源產品文件: Google Drive
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Google Drive 至 Google Cloud Storage 傳輸運算子
Python API: airflow.providers.google.cloud.transfers.gdrive_to_gcs
供應商: apache-airflow-providers-google

Microsoft Azure FileShare 至 Google Cloud Storage (GCS)¶

來源產品文件: Microsoft Azure FileShare
目標產品文件: Google Cloud Storage (GCS)
運算子指南: 將資料從 Azure FileShare Storage 傳輸至 Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.azure_fileshare_to_gcs
供應商: apache-airflow-providers-google

Apache Cassandra 至 Google Cloud Storage (GCS)¶

來源產品文件: Apache Cassandra
目標產品文件: Google Cloud Storage (GCS)
Python API: airflow.providers.google.cloud.transfers.cassandra_to_gcs
供應商: apache-airflow-providers-google

Google Calendar 至 Google Cloud Storage (GCS)¶

來源產品文件: Google Calendar
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Google Calendar 至 Google Cloud Storage 傳輸運算子
Python API: airflow.providers.google.cloud.transfers.calendar_to_gcs
供應商: apache-airflow-providers-google

Google Spreadsheet 至 Google Cloud Storage (GCS)¶

來源產品文件: Google Spreadsheet
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Google Sheets 至 Google Cloud Storage 傳輸運算子
Python API: airflow.providers.google.cloud.transfers.sheets_to_gcs
供應商: apache-airflow-providers-google

Amazon Simple Storage Service (S3) 至 Google Cloud Storage (GCS)¶

來源產品文件: Amazon Simple Storage Service (S3)
目標產品文件: Google Cloud Storage (GCS)
運算子指南: 將資料從 Amazon S3 傳輸至 Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.s3_to_gcs
供應商: apache-airflow-providers-google

Google Cloud Storage (GCS) 至 SSH File Transfer Protocol (SFTP)¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: SSH File Transfer Protocol (SFTP)
運算子指南: Google Cloud Storage 傳輸運算子至 SFTP
Python API: airflow.providers.google.cloud.transfers.gcs_to_sftp
供應商: apache-airflow-providers-google

PostgreSQL 至 Google Cloud Storage (GCS)¶

來源產品文件: PostgreSQL
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Postgres 至 Google Cloud Storage 運算子
Python API: airflow.providers.google.cloud.transfers.postgres_to_gcs
供應商: apache-airflow-providers-google

Google BigQuery 至通用 SQL¶

來源產品文件: Google BigQuery
目標產品文件: 通用 SQL
Python API: airflow.providers.google.cloud.transfers.bigquery_to_sql
供應商: apache-airflow-providers-google

Google BigQuery 至 MySQL¶

來源產品文件: Google BigQuery
目標產品文件: MySQL
運算子指南: Google Cloud BigQuery 傳輸運算子至 MySQL
Python API: airflow.providers.google.cloud.transfers.bigquery_to_mysql
供應商: apache-airflow-providers-google

Google BigQuery 至 Microsoft SQL Server (MSSQL)¶

來源產品文件: Google BigQuery
目標產品文件: Microsoft SQL Server (MSSQL)
運算子指南: Google Cloud BigQuery 傳輸運算子至 Microsoft SQL Server
Python API: airflow.providers.google.cloud.transfers.bigquery_to_mssql
供應商: apache-airflow-providers-google

Google BigQuery 至 PostgreSQL¶

來源產品文件: Google BigQuery
目標產品文件: PostgreSQL
運算子指南: Google Cloud BigQuery 傳輸運算子至 Postgres
Python API: airflow.providers.google.cloud.transfers.bigquery_to_postgres
供應商: apache-airflow-providers-google

Google Cloud Storage (GCS) 至 Google BigQuery¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Google BigQuery
運算子指南: Google Cloud Storage 傳輸運算子至 BigQuery
Python API: airflow.providers.google.cloud.transfers.gcs_to_bigquery
供應商: apache-airflow-providers-google

Google Cloud Storage (GCS) 至 Google Cloud Storage (GCS)¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Google Cloud Storage (GCS)
運算子指南: 在 Google Cloud Storage 中傳輸資料
Python API: airflow.providers.google.cloud.transfers.gcs_to_gcs
供應商: apache-airflow-providers-google

Facebook Ads 至 Google Cloud Storage (GCS)¶

來源產品文件: Facebook Ads
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Facebook Ads 至 GCS 運算子
Python API: airflow.providers.google.cloud.transfers.facebook_ads_to_gcs
供應商: apache-airflow-providers-google

SSH File Transfer Protocol (SFTP) 至 Google Cloud Storage (GCS)¶

來源產品文件: SSH File Transfer Protocol (SFTP)
目標產品文件: Google Cloud Storage (GCS)
運算子指南: SFTP 至 Google Cloud Storage 傳輸運算子
Python API: airflow.providers.google.cloud.transfers.sftp_to_gcs
供應商: apache-airflow-providers-google

Microsoft Azure Data Lake Storage 至 Google Cloud Storage (GCS)¶

來源產品文件: Microsoft Azure Data Lake Storage
目標產品文件: Google Cloud Storage (GCS)
Python API: airflow.providers.google.cloud.transfers.adls_to_gcs
供應商: apache-airflow-providers-google

Google BigQuery 至 Google BigQuery¶

來源產品文件: Google BigQuery
目標產品文件: Google BigQuery
運算子指南: Google Cloud BigQuery 傳輸運算子至 BigQuery
Python API: airflow.providers.google.cloud.transfers.bigquery_to_bigquery
供應商: apache-airflow-providers-google

MySQL 至 Google Cloud Storage (GCS)¶

來源產品文件: MySQL
目標產品文件: Google Cloud Storage (GCS)
運算子指南: MySQL 至 Google Cloud Storage 運算子
Python API: airflow.providers.google.cloud.transfers.mysql_to_gcs
供應商: apache-airflow-providers-google

Oracle 至 Google Cloud Storage (GCS)¶

來源產品文件: Oracle
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Oracle 至 Google Cloud Storage 運算子
Python API: airflow.providers.google.cloud.transfers.oracle_to_gcs
供應商: apache-airflow-providers-google

Google Cloud Storage (GCS) 至 Google Spreadsheet¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Google Spreadsheet
運算子指南: Google Cloud Storage 至 Google Sheets 傳輸運算子
Python API: airflow.providers.google.suite.transfers.gcs_to_sheets
供應商: apache-airflow-providers-google

Local 至 Google Cloud Storage (GCS)¶

目標產品文件: Google Cloud Storage (GCS)
運算子指南: 將資料從本機檔案系統上傳至 Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.local_to_gcs
供應商: apache-airflow-providers-google

Google BigQuery 至 Google Cloud Storage (GCS)¶

來源產品文件: Google BigQuery
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Google Cloud BigQuery 傳輸運算子至 Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.bigquery_to_gcs
供應商: apache-airflow-providers-google

Google Cloud Storage (GCS) 至 Local¶

來源產品文件: Google Cloud Storage (GCS)
運算子指南: 將資料從 Google Cloud Storage 下載至本機檔案系統
Python API: airflow.providers.google.cloud.transfers.gcs_to_local
供應商: apache-airflow-providers-google

Salesforce 至 Google Cloud Storage (GCS)¶

來源產品文件: Salesforce
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Salesforce 至 GCS 運算子
Python API: airflow.providers.google.cloud.transfers.salesforce_to_gcs
供應商: apache-airflow-providers-google

Google Ads 至 Google Cloud Storage (GCS)¶

來源產品文件: Google Ads
目標產品文件: Google Cloud Storage (GCS)
Python API: airflow.providers.google.ads.transfers.ads_to_gcs
供應商: apache-airflow-providers-google

Microsoft SQL Server (MSSQL) 至 Google Cloud Storage (GCS)¶

來源產品文件: Microsoft SQL Server (MSSQL)
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Microsoft SQL Server 至 Google Cloud Storage 運算子
Python API: airflow.providers.google.cloud.transfers.mssql_to_gcs
供應商: apache-airflow-providers-google

Microsoft Azure Blob Storage 至 Google Cloud Storage (GCS)¶

來源產品文件: Microsoft Azure Blob Storage
目標產品文件: Google Cloud Storage (GCS)
運算子指南: Azure Blob Storage 至 Google Cloud Storage (GCS) 傳輸運算子
Python API: airflow.providers.google.cloud.transfers.azure_blob_to_gcs
供應商: apache-airflow-providers-google

Google Cloud Storage (GCS) 至 Presto¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Presto
運算子指南: Google Cloud Storage 至 Presto 傳輸運算子
Python API: airflow.providers.presto.transfers.gcs_to_presto
供應商: apache-airflow-providers-presto

Google Cloud Storage (GCS) 至 Samba¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Samba
運算子指南: Google Cloud Storage 傳輸運算子至 Samba
Python API: airflow.providers.samba.transfers.gcs_to_samba
供應商: apache-airflow-providers-samba

Google Cloud Storage (GCS) 至 Snowflake¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Snowflake
Python API: airflow.providers.snowflake.transfers.copy_into_snowflake
供應商: apache-airflow-providers-snowflake

Google Cloud Storage (GCS) 至 Trino¶

來源產品文件: Google Cloud Storage (GCS)
目標產品文件: Trino
運算子指南: Google Cloud Storage 至 Trino 傳輸運算子
Python API: airflow.providers.trino.transfers.gcs_to_trino
供應商: apache-airflow-providers-trino

Google Marketing Platform¶

注意

您可以透過分析範例 DAG 的原始碼，學習如何使用 Google Marketing Platform 整合。

Google Ads¶

運算子: airflow.providers.google.ads.operators.ads.
Hook: airflow.providers.google.ads.hooks.ads.
指南: Google Ads 運算子.
供應商: apache-airflow-providers-google
產品文件: Google Ads

Google Analytics (GA4)¶

運算子: airflow.providers.google.marketing_platform.operators.analytics_admin.
Hook: airflow.providers.google.marketing_platform.hooks.analytics_admin.
指南: Google Analytics (GA4) 管理員運算子.
供應商: apache-airflow-providers-google
產品文件: Google Analytics (GA4)

Google Display&Video 360¶

運算子: airflow.providers.google.marketing_platform.operators.display_video.
Hook: airflow.providers.google.marketing_platform.hooks.display_video.
感測器: airflow.providers.google.marketing_platform.sensors.display_video.
指南: Google Display & Video 360 運算子.
供應商: apache-airflow-providers-google
產品文件: Google Display&Video 360

Google Search Ads 360¶

運算子: airflow.providers.google.marketing_platform.operators.search_ads.
Hook: airflow.providers.google.marketing_platform.hooks.search_ads.
指南: Google Search Ads 運算子.
供應商: apache-airflow-providers-google
產品文件: Google Search Ads 360

其他 Google 運算子和 Hook¶

Google¶

Hook: airflow.providers.google.common.hooks.base_google.
供應商: apache-airflow-providers-google
產品文件: Google

Google Calendar¶

Hook: airflow.providers.google.suite.hooks.calendar.
供應商: apache-airflow-providers-google
產品文件: Google Calendar

Google Cloud Batch¶

運算子: airflow.providers.google.cloud.operators.cloud_batch.
Hook: airflow.providers.google.cloud.hooks.cloud_batch.
指南: Google Cloud Batch 運算子.
供應商: apache-airflow-providers-google
產品文件: Google Cloud Batch

Google Cloud Composer¶

運算子: airflow.providers.google.cloud.operators.cloud_composer.
Hook: airflow.providers.google.cloud.hooks.cloud_composer.
感測器: airflow.providers.google.cloud.sensors.cloud_composer.
指南: Google Cloud Composer 運算子.
供應商: apache-airflow-providers-google
產品文件: Google Cloud Composer

Google Cloud Dataform¶

運算子: airflow.providers.google.cloud.operators.dataform.
Hook: airflow.providers.google.cloud.hooks.dataform.
感測器: airflow.providers.google.cloud.sensors.dataform.
指南: Google Dataform 運算子.
供應商: apache-airflow-providers-google
產品文件: Google Cloud Dataform

Google Cloud Run¶

運算子: airflow.providers.google.cloud.operators.cloud_run.
Hook: airflow.providers.google.cloud.hooks.cloud_run.
指南: Google Cloud Run 運算子.
供應商: apache-airflow-providers-google
產品文件: Google Cloud Run

Google Discovery API¶

Hook: airflow.providers.google.common.hooks.discovery_api.
供應商: apache-airflow-providers-google
產品文件: Google Discovery API

Google Drive¶

Hook: airflow.providers.google.suite.hooks.drive.
感測器: airflow.providers.google.suite.sensors.drive.
供應商: apache-airflow-providers-google
產品文件: Google Drive

Google LevelDB¶

運算子: airflow.providers.google.leveldb.operators.leveldb.
Hook: airflow.providers.google.leveldb.hooks.leveldb.
指南: Google LevelDB Operator.
供應商: apache-airflow-providers-google
產品文件: Google LevelDB

Google Spreadsheet¶

運算子: airflow.providers.google.suite.operators.sheets.
Hook: airflow.providers.google.suite.hooks.sheets.
指南: Google Sheets Operators.
供應商: apache-airflow-providers-google
產品文件: Google Spreadsheet

Google¶

Google Cloud¶

服務¶

Google AutoML¶

Google BigQuery¶

Google BigQuery Data Transfer Service¶

Google Bigtable¶

Google Campaign Manager¶

Google Cloud AlloyDB¶

Google Cloud Build¶

Google Cloud Common¶

Google Cloud Data Loss Prevention (DLP)¶

Google Cloud Firestore¶

Google Cloud Functions¶

Google Cloud Key Management Service (KMS)¶

Google Cloud Life Sciences¶

Google Cloud Memorystore¶

Google Cloud Natural Language¶

Google Cloud OS Login¶

Google Cloud Pub/Sub¶

Google Cloud Secret Manager¶

Google Cloud Spanner¶

Google Cloud Speech-to-Text¶

Google Cloud SQL¶

Google Cloud Stackdriver¶

Google Cloud Storage (GCS)¶

Google Cloud Storage Transfer Service¶

Google Cloud Tasks¶

Google Cloud Text-to-Speech¶

Google Cloud Translation¶

Google Cloud Video Intelligence¶

Google Cloud Vision¶

Google Cloud Workflows¶

Google Compute Engine¶

Google Data Catalog¶

Google Data Fusion¶

Google Dataflow¶

Google Dataplex¶

Google Dataprep¶

Google Dataproc¶

Google Dataproc Metastore¶

Google Datastore¶

Google Deployment Manager¶

Google Kubernetes Engine¶

Google Looker¶

Google Machine Learning Engine¶

Google Vertex AI¶

傳輸¶

Google Cloud Storage (GCS) 至 Amazon Simple Storage Service (S3)¶

Amazon Glacier 至 Google Cloud Storage (GCS)¶

Presto 至 Google Cloud Storage (GCS)¶

Trino 至 Google Cloud Storage (GCS)¶

通用 SQL 至 Google Cloud Storage (GCS)¶

Google Cloud Storage (GCS) 至 Google Drive¶

Google Drive 至 Google Cloud Storage (GCS)¶

Microsoft Azure FileShare 至 Google Cloud Storage (GCS)¶

Apache Cassandra 至 Google Cloud Storage (GCS)¶

Google Calendar 至 Google Cloud Storage (GCS)¶

Google Spreadsheet 至 Google Cloud Storage (GCS)¶

Amazon Simple Storage Service (S3) 至 Google Cloud Storage (GCS)¶

Google Cloud Storage (GCS) 至 SSH File Transfer Protocol (SFTP)¶

PostgreSQL 至 Google Cloud Storage (GCS)¶

Google BigQuery 至通用 SQL¶

Google BigQuery 至 MySQL¶

Google BigQuery 至 Microsoft SQL Server (MSSQL)¶

Google BigQuery 至 PostgreSQL¶

Google Cloud Storage (GCS) 至 Google BigQuery¶

Google Cloud Storage (GCS) 至 Google Cloud Storage (GCS)¶

Facebook Ads 至 Google Cloud Storage (GCS)¶

SSH File Transfer Protocol (SFTP) 至 Google Cloud Storage (GCS)¶

Microsoft Azure Data Lake Storage 至 Google Cloud Storage (GCS)¶

Google BigQuery 至 Google BigQuery¶

MySQL 至 Google Cloud Storage (GCS)¶

Oracle 至 Google Cloud Storage (GCS)¶

Google Cloud Storage (GCS) 至 Google Spreadsheet¶

Local 至 Google Cloud Storage (GCS)¶

Google BigQuery 至 Google Cloud Storage (GCS)¶

Google Cloud Storage (GCS) 至 Local¶

Salesforce 至 Google Cloud Storage (GCS)¶

Google Ads 至 Google Cloud Storage (GCS)¶