Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove airflow_version from k8s executor pod selector #42751

Merged

Conversation

dstandish
Copy link
Contributor

When there is a task running and upgrade in flight then there will be version mismatch. So we should not include the airflow version in the selector.

When there is a task running and upgrade in flight then there will be version mismatch.  So we should not include the airflow version in the selector.
@potiuk potiuk merged commit 24b7c5b into apache:main Oct 5, 2024
69 checks passed
jscheffl pushed a commit to potiuk/airflow that referenced this pull request Oct 5, 2024
The apache#42751 removed airflow_version from k8s log handler and
apparently some tests in tests_utils still use kubernetes provider
and k8s test handler. Also it turned out some other tests
used Celery Executor as well.

Fixed the tests and move them to K8S / Celery provider respectively.
jscheffl pushed a commit to jscheffl/airflow that referenced this pull request Oct 5, 2024
The apache#42751 removed airflow_version from k8s log handler and
apparently some tests in tests_utils still use kubernetes provider
and k8s test handler. Also it turned out some other tests
used Celery Executor as well.

Fixed the tests and move them to K8S / Celery provider respectively.
jscheffl added a commit that referenced this pull request Oct 5, 2024
* Fix failing log test handler tests

The #42751 removed airflow_version from k8s log handler and
apparently some tests in tests_utils still use kubernetes provider
and k8s test handler. Also it turned out some other tests
used Celery Executor as well.

Fixed the tests and move them to K8S / Celery provider respectively.

* Attempt to fix side-effect from other tests logging config

* Fix Task Log Handler for Celery

* Fix SQL Hook Test

* Skip task log handler in Airflow 2.8

* set try number in celeryexecutor test

* remove skipif

---------

Co-authored-by: Jarek Potiuk <[email protected]>
Co-authored-by: Jens Scheffler <[email protected]>
@jedcunningham jedcunningham deleted the exclude-version-in-pod-selector-k8s-exec branch October 7, 2024 16:41
kunaljubce pushed a commit to kunaljubce/airflow that referenced this pull request Oct 13, 2024
* Fix failing log test handler tests

The apache#42751 removed airflow_version from k8s log handler and
apparently some tests in tests_utils still use kubernetes provider
and k8s test handler. Also it turned out some other tests
used Celery Executor as well.

Fixed the tests and move them to K8S / Celery provider respectively.

* Attempt to fix side-effect from other tests logging config

* Fix Task Log Handler for Celery

* Fix SQL Hook Test

* Skip task log handler in Airflow 2.8

* set try number in celeryexecutor test

* remove skipif

---------

Co-authored-by: Jarek Potiuk <[email protected]>
Co-authored-by: Jens Scheffler <[email protected]>
joaopamaral pushed a commit to joaopamaral/airflow that referenced this pull request Oct 21, 2024
When there is a task running and upgrade in flight then there will be version mismatch.  So we should not include the airflow version in the selector.
joaopamaral pushed a commit to joaopamaral/airflow that referenced this pull request Oct 21, 2024
* Fix failing log test handler tests

The apache#42751 removed airflow_version from k8s log handler and
apparently some tests in tests_utils still use kubernetes provider
and k8s test handler. Also it turned out some other tests
used Celery Executor as well.

Fixed the tests and move them to K8S / Celery provider respectively.

* Attempt to fix side-effect from other tests logging config

* Fix Task Log Handler for Celery

* Fix SQL Hook Test

* Skip task log handler in Airflow 2.8

* set try number in celeryexecutor test

* remove skipif

---------

Co-authored-by: Jarek Potiuk <[email protected]>
Co-authored-by: Jens Scheffler <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:providers provider:cncf-kubernetes Kubernetes provider related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Webserver cannot read logs of pods launched by a scheduler of mismatching Airflow version
4 participants