Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task Killed because Recorded pid does not match the current pid #39423

Open
1 of 2 tasks
BPhadael opened this issue May 6, 2024 · 1 comment
Open
1 of 2 tasks

Task Killed because Recorded pid does not match the current pid #39423

BPhadael opened this issue May 6, 2024 · 1 comment
Labels
area:core kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet

Comments

@BPhadael
Copy link

BPhadael commented May 6, 2024

Apache Airflow version

2.9.0

If "Other Airflow 2 version" selected, which one?

No response

What happened?

I created a dag_executor_user as a primary user to run DAGs, while using the airflow user to run the processes (webserver, scheduler, worker). When the dag executor user is set in default impersonation it cannot run DAGs that use the bash operator (this is expected), but when setting run_as_user = airflow in the DAG, tasks fail with the following errors:

WARNING - Recorded pid 10310 does not match the current pid 10316
Sending the signal 15 to group 10316
ERROR - Received SIGTERM. Terminating subproccess

What you think should happen instead?

Expecting task to run as the airflow user (which had no trouble running tasks before adding the dag executor user with default impersonation)

How to reproduce

  1. Create second user without sudo permissions
  2. Set second user as default_impersonation value in airflow.cfg
  3. In a dag using bash operator, set run_as_user to the value of the user running the airflow processes.

Operating System

Amazon Linux 2

Versions of Apache Airflow Providers

No response

Deployment

Docker-Compose

Deployment details

No response

Anything else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@BPhadael BPhadael added area:core kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet labels May 6, 2024
Copy link

boring-cyborg bot commented May 6, 2024

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:core kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet
Projects
None yet
Development

No branches or pull requests

1 participant