apache-airflow-providers-celery

變更日誌¶

3.9.0¶

注意

此供應商版本僅適用於 Airflow 2.9+，如 Apache Airflow 供應商支援政策中所述。

雜項¶

Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)
AIP-81 Move CLI Commands to directories according to Hybrid, Local and Remote (#44538)
Remove AIP-44 configuration from the code (#44454)

3.8.5¶

錯誤修正¶

Re-queue tassk when they are stuck in queued (#43520)

3.8.4¶

雜項¶

AIP-72: Remove DAG pickling (#43667)
Move python operator to Standard provider (#42081)

3.8.3¶

錯誤修正¶

All executors should inherit from BaseExecutor (#41904)
Remove state sync during celery task processing (#41870)

雜項¶

Change imports to use Standard provider for BashOperator (#42252)

3.8.2¶

雜項¶

remove deprecated soft_fail from providers (#41710)

3.8.1¶

錯誤修正¶

fix: Missing 'slots_occupied' in 'CeleryKubernetesExecutor' and 'LocalKubernetesExecutor' (#41602)

3.8.0¶

注意

此供應商版本僅適用於 Airflow 2.8+，如 Apache Airflow 供應商支援政策中所述。

雜項¶

Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)
Remove deprecated SubDags (#41390)

3.7.3¶

錯誤修正¶

Increase broker's visibility timeout to 24hrs (#40879)

3.7.2¶

錯誤修正¶

Fixing exception types to include TypeError, which is what is raised in (#40012)
catch sentry flush if exception happens in _execute_in_fork finally block (#40060)

雜項¶

Add PID and return code to _execute_in_fork logging (#40058)

3.7.1¶

雜項¶

Faster 'airflow_version' imports (#39552)
Simplify 'airflow_version' imports (#39497)
ECS Executor: Set tasks to RUNNING state once active (#39212)
Remove compat code for 2.7.0 - its now the min Airflow version (#39591)
misc: add comment about remove unused code (#39748)

3.7.0¶

注意

此供應商版本僅適用於 Airflow 2.7+，如 Apache Airflow 供應商支援政策中所述。

雜項¶

Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)

3.6.2¶

錯誤修正¶

Ensure __exit__ is called in decorator context managers (#38383)
Don't dispose sqlalchemy engine when using internal api (#38562)
Use celery worker CLI from Airflow package for Airflow < 2.8.0 (#38879)

雜項¶

Allow to use 'redis'>=5 (#38385)
Reraise of AirflowOptionalProviderFeatureException should be direct (#38555)

3.6.1¶

錯誤修正¶

Remove pid arg from celery option to fix duplicate pid issue, Move celery command to provider package (#36794)
Change AirflowTaskTimeout to inherit BaseException (#35653)

雜項¶

Migrate executor docs to respective providers (#37728)

3.6.0¶

功能¶

Add 'task_acks_late' configuration to Celery Executor (#37066)

雜項¶

improve info for prevent celery command autoscale misconfig (#36576)

3.5.2¶

錯誤修正¶

Fix stacklevel in warnings.warn into the providers (#36831)

3.5.1¶

錯誤修正¶

Fix 'sentinel_kwargs' load from ENV (#36318)

3.5.0¶

注意

此供應商版本僅適用於 Airflow 2.6+，如 Apache Airflow 供應商支援政策中所述。

雜項¶

Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)

3.4.1¶

錯誤修正¶

Fix _SECRET and _CMD broker configuration (#34782)
Remove sensitive information from Celery executor warning (#34954)

3.4.0¶

注意

此供應商版本僅適用於 Airflow 2.5+，如 Apache Airflow 供應商支援政策中所述。

雜項¶

Bump min airflow version of providers (#34728)
respect soft_fail argument when exception is raised for celery sensors (#34474)

3.3.4¶

錯誤修正¶

Fix condition of update_task_state in celery executor (#34192)

雜項¶

Combine similar if logics in providers (#33987)
Limit celery by excluding 5.3.2 and 5.3.3 (#34031)
Replace try - except pass by contextlib.suppress in providers (#33980)
Improve modules import in Airflow providers by some of them into a type-checking block (#33754)

3.3.3¶

錯誤修正¶

Fix dependencies for celery and opentelemetry for Python 3.8 (#33579)

雜項¶

Make auth managers provide their own airflow CLI commands (#33481)
Refactor Sqlalchemy queries to 2.0 style (Part 7) (#32883)

3.3.2¶

雜項¶

Add missing re2 dependency to cncf.kubernetes and celery providers (#33237)
Replace State by TaskInstanceState in Airflow executors (#32627)

3.3.1¶

雜項¶

aDd documentation generation for CLI commands from executors (#33081)
Get rid of Python2 numeric relics (#33050)

3.3.0¶

注意

此供應商版本是第一個將 Celery Executor 和 Celery Kubernetes Executor 從核心 apache-airflow 套件移至 Celery 供應商套件的版本。它也預期已安裝版本 7.4.0+ 的 apache-airflow-providers-cncf-kubernetes，以便使用 CeleryKubernetesExecutor。您可以使用 pip install apache-airflow-providers-celery[cncf.kubernetes] 安裝具有 cncf.kubernetes 額外功能的供應商，以取得正確版本的 cncf.kubernetes 供應商。

功能¶

Move CeleryExecutor to the celery provider (#32526)
Add pre-Airflow-2-7 hardcoded defaults for config for older providers (#32775)
[AIP-51] Executors vending CLI commands (#29055)

雜項¶

Move all k8S classes to cncf.kubernetes provider (#32767)
Add Executors discovery and documentation (#32532)
Move default_celery.py to inside the provider (#32628)
Raise original import error in CLI vending of executors (#32931)

3.2.1¶

注意

此版本已停止支援 Python 3.7

雜項¶

Add note about dropping Python 3.7 for providers (#32015)

3.2.0¶

注意

此供應商版本僅適用於 Airflow 2.4+，如 Apache Airflow 供應商支援政策中所述。

雜項¶

Bump minimum Airflow version in providers (#30917)

3.1.0¶

注意

此供應商版本僅適用於 Airflow 2.3+，如 Apache Airflow 供應商支援政策中所述。

雜項¶

Move min airflow version to 2.3.0 for all providers (#27196)

3.0.0¶

重大變更¶

注意

此供應商版本僅適用於 Airflow 2.2+，如 Apache Airflow 供應商支援政策中所述。

2.1.4¶

雜項¶

Update our approach for executor-bound dependencies (#22573)

2.1.3¶

錯誤修正¶

Fix mistakenly added install_requires for all providers (#22382)

2.1.2¶

雜項¶

Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)

2.1.1¶

雜項¶

Support for Python 3.10

2.1.0¶

功能¶

The celery provider is converted to work with Celery 5 following airflow 2.2.0 change of Celery version

2.0.0¶

重大變更¶

Auto-apply apply_default decorator (#15667)

警告

由於移除了 apply_default 裝飾器，此版本的供應商需要 Airflow 2.1.0+。如果您的 Airflow 版本小於 2.1.0，並且您想要安裝此供應商版本，請先將 Airflow 升級至至少 2.1.0 版本。否則，您的 Airflow 套件版本將會自動升級，並且您將必須手動執行 airflow upgrade db 以完成移轉。

1.0.1¶

更新文件和 readme 檔案。

1.0.0¶

供應商的初始版本。