task remains on Pending #101

ghost · 2023-01-08T13:35:45Z

Describe the bug
The processes cannot be executed, the status of the task remains on Pending.

To Reproduce
Steps to reproduce the behavior:

Activate cloud_py_api app
activate MediaDC app
create rule to delete in Media DC app
wait
the status of the task remains on Pending

Desktop (please complete the following information):

OS [Ubuntu]
CPU [architecture x86]
Nextcloud version [25]
Database configuration [postgres]
MediaDC version [0.3.2]
cloud_py_api version [0.1.1]

Nextcloud AIO latest Stable

Additional context
nextcloud/all-in-one#1701

The text was updated successfully, but these errors were encountered:

andrey18106 · 2023-01-08T13:48:39Z

@R7JANV1 Thanks for reporting, possibly duplicate of #100.

Checkout wiki notice and try manual installation instead of pre-compiled binaries (seems like some issue with permission).

If you have any new info about that bug, feel free to write here.

zainvegeta · 2023-01-11T19:29:25Z

Facing the same issue with following log
ERROR:nc_py_api:occ:php_call:php_call exception:
Traceback (most recent call last):
File "/tmp/onefile_7215_1673465229_464283/nc_py_api/occ.py", line 54, in php_call
File "/tmp/onefile_7215_1673465229_464283/subprocess.py", line 528, in run
subprocess.CalledProcessError: Command '['php', '/var/www/nextcloud/occ', '--no-warnings', 'config:system:get', 'dbname']' returned non-zero exit status 1.
ERROR:nc_py_api:config::Cant find {dbname} value in NC config.
ERROR:nc_py_api:occ:php_call:php_call exception:
Traceback (most recent call last):
File "/tmp/onefile_7215_1673465229_464283/nc_py_api/occ.py", line 54, in php_call
File "/tmp/onefile_7215_1673465229_464283/subprocess.py", line 528, in run
subprocess.CalledProcessError: Command '['php', '/var/www/nextcloud/occ', '--no-warnings', 'config:system:get', 'dbuser']' returned non-zero exit status 1.
ERROR:nc_py_api:config::Cant find {dbuser} value in NC config.
ERROR:nc_py_api:occ:php_call:php_call exception:
Traceback (most recent call last):
File "/tmp/onefile_7215_1673465229_464283/nc_py_api/occ.py", line 54, in php_call
File "/tmp/onefile_7215_1673465229_464283/subprocess.py", line 528, in run
subprocess.CalledProcessError: Command '['php', '/var/www/nextcloud/occ', '--no-warnings', 'config:system:get', 'dbpassword']' returned non-zero exit status 1.
ERROR:nc_py_api:config::Cant find {dbpassword} value in NC config.
ERROR:nc_py_api:occ:php_call:php_call exception:
Traceback (most recent call last):
File "/tmp/onefile_7215_1673465229_464283/nc_py_api/occ.py", line 54, in php_call
File "/tmp/onefile_7215_1673465229_464283/subprocess.py", line 528, in run
subprocess.CalledProcessError: Command '['php', '/var/www/nextcloud/occ', '--no-warnings', 'config:system:get', 'dbhost']' returned non-zero exit status 1.
ERROR:nc_py_api:config::Cant find {dbhost} value in NC config.
ERROR:nc_py_api:occ:php_call:php_call exception:
Traceback (most recent call last):
File "/tmp/onefile_7215_1673465229_464283/nc_py_api/occ.py", line 54, in php_call
File "/tmp/onefile_7215_1673465229_464283/subprocess.py", line 528, in run
subprocess.CalledProcessError: Command '['php', '/var/www/nextcloud/occ', '--no-warnings', 'config:system:get', 'dbtype']' returned non-zero exit status 1.
ERROR:nc_py_api:config::Cant find {dbtype} value in NC config.
ERROR:nc_py_api:occ:php_call:php_call exception:
Traceback (most recent call last):
File "/tmp/onefile_7215_1673465229_464283/nc_py_api/occ.py", line 54, in php_call
File "/tmp/onefile_7215_1673465229_464283/subprocess.py", line 528, in run
subprocess.CalledProcessError: Command '['php', '/var/www/nextcloud/occ', '--no-warnings', 'config:system:get', 'datadirectory']' returned non-zero exit status 1.
ERROR:nc_py_api:config::Cant find {datadirectory} value in NC config.
INFO:nc_py_api.mediadc:bundle_info:bundle_info:Python: 3.9.16 (main, Dec 19 2022, 10:54:04)
[GCC 10.2.1 20210130 (Red Hat 10.2.1-11)]
INFO:nc_py_api.mediadc:bundle_info:bundle_info:nc_py_api: 0.0.8
INFO:nc_py_api.mediadc:bundle_info:bundle_info:mediadc: 0.3.0
INFO:nc_py_api.mediadc:bundle_info:bundle_info:pg8000: 1.29.4
INFO:nc_py_api.mediadc:bundle_info:bundle_info:pynacl: 1.5.0
INFO:nc_py_api.mediadc:bundle_info:bundle_info:cryptography: 38.0.4
INFO:nc_py_api.mediadc:bundle_info:bundle_info:pymysql: 1.0.2
INFO:nc_py_api.mediadc:bundle_info:bundle_info:pillow: 9.3.0
INFO:nc_py_api.mediadc:bundle_info:bundle_info:pi_heif: 0.9.0
INFO:nc_py_api.mediadc:bundle_info:bundle_info:numpy: 1.21.4
INFO:nc_py_api.mediadc:bundle_info:bundle_info:scipy: 1.7.2
INFO:nc_py_api.mediadc:bundle_info:bundle_info:pywavelets: 1.4.1

Tried manual installation instead of pre-compiled binaries still same error

timonline · 2023-01-11T21:53:07Z

I am seeing the same issue

root@c4df08b5fb48:/# sudo -H python3 -m pip install -r /config/www/nextcloud/apps/mediadc/requirements.txt 
Requirement already satisfied: pynacl in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 1)) (1.5.0)
Requirement already satisfied: numpy in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 2)) (1.24.1)
Requirement already satisfied: scipy in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 3)) (1.10.0)
Requirement already satisfied: pywavelets in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 4)) (1.4.1)
Requirement already satisfied: pillow in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 5)) (9.4.0)
Requirement already satisfied: hexhamming in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 6)) (2.2.3)
Requirement already satisfied: nc-py-api>=0.0.8 in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (0.0.9)
Requirement already satisfied: pi-heif>=0.9.0 in /usr/lib/python3.9/site-packages (from -r /config/www/nextcloud/apps/mediadc/requirements.txt (line 8)) (0.9.1)
Requirement already satisfied: cffi>=1.4.1 in /usr/lib/python3.9/site-packages (from pynacl->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 1)) (1.15.1)
Requirement already satisfied: pymysql in /usr/lib/python3.9/site-packages (from nc-py-api>=0.0.8->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (1.0.2)
Requirement already satisfied: cryptography in /usr/lib/python3.9/site-packages (from nc-py-api>=0.0.8->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (39.0.0)
Requirement already satisfied: pg8000 in /usr/lib/python3.9/site-packages (from nc-py-api>=0.0.8->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (1.29.4)
Requirement already satisfied: pycparser in /usr/lib/python3.9/site-packages (from cffi>=1.4.1->pynacl->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 1)) (2.21)
Requirement already satisfied: scramp>=1.4.3 in /usr/lib/python3.9/site-packages (from pg8000->nc-py-api>=0.0.8->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (1.4.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/lib/python3.9/site-packages (from pg8000->nc-py-api>=0.0.8->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (2.8.2)
Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil>=2.8.2->pg8000->nc-py-api>=0.0.8->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (1.16.0)
Requirement already satisfied: asn1crypto>=1.5.1 in /usr/lib/python3.9/site-packages (from scramp>=1.4.3->pg8000->nc-py-api>=0.0.8->-r /config/www/nextcloud/apps/mediadc/requirements.txt (line 7)) (1.5.1)

Yet the log shows this:

tail -f /config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/logs/11-01-2023_21\:47\:44.log 
nohup: failed to run command '/config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/binaries/main': No such file or directory

root@c4df08b5fb48:/config/www/nextcloud/apps/mediadc# ls -l /config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/binaries/main
-rwxrwxrwx 1 abc abc 233389410 Jan 11 15:33 /config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/binaries/main

bigcat88 · 2023-01-11T22:08:29Z

@timonline does this log is from run with unchecked Use pre-compilbed Python binaries box in cloud_py_api?

As I see you installing python dependencies, I assume that you try running from source, am I right?

timonline · 2023-01-11T22:13:30Z

@timonline does this log is from run with unchecked Use pre-compilbed Python binaries box in cloud_py_api?

As I see you installing python dependencies, I assume that you try running from source, am I right?

Yes I’m using the requirement file from the source and yes the pre compiled python binaries is set

andrey18106 · 2023-01-11T22:18:35Z

Yes I’m using the requirement file from the source and yes the pre compiled python binaries is set

Use pre-compiled Python binaries option must be disabled (unchecked) for usage from sources with manually installed Python packages.

timonline · 2023-01-11T22:28:50Z

Yes I’m using the requirement file from the source and yes the pre compiled python binaries is set

Use pre-compiled Python binaries option must be disabled (unchecked) for usage from sources with manually installed Python packages.

that did the trick, thank you. Now i am finally seeing the tasks progress instead of being stuck in pending

bigcat88 · 2023-01-11T22:29:11Z

@timonline can you (or someone else with such problem) describe how we can reproduce this, what do specific your installations have which leads to situation where php cannot start binary file - looks like we miss something when rewriting code.

andrey18106 · 2023-01-11T23:06:27Z

@timonline Could you check one thing please:

Edit two lines of cloud_py_api app file

change : to - in paths to logs on lines 116 and 121

L116: from $logFile = $cwd . 'logs/' . date('d-m-Y_H:i:s', time()) . '.log'; to $logFile = $cwd . 'logs/' . date('d-m-Y_H-i-s', time()) . '.log';

L121: from $logFile = $appDataDir . 'logs/' . date('d-m-Y_H:i:s', time()) . '.log'; to $logFile = $appDataDir . 'logs/' . date('d-m-Y_H-i-s', time()) . '.log';

Enable Use pre-compiled Python binaries in MediaDC Admin settings
Restart some task

timonline · 2023-01-12T00:19:04Z

@andrey18106 the naming format of the file changed but the error came back

root@c4df08b5fb48:/config/www/nextcloud/apps# ls -l /config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/logs/
total 20
-rw-r--r-- 1 abc abc  128 Jan 11 15:34 11-01-2023_21:34:11.log
-rw-r--r-- 1 abc abc  128 Jan 11 15:47 11-01-2023_21:47:44.log
-rw-r--r-- 1 abc abc   49 Jan 11 16:26 11-01-2023_22:26:07.log
-rw-r--r-- 1 abc abc 3075 Jan 11 17:54 11-01-2023_22:27:11.log
-rw-r--r-- 1 abc abc  128 Jan 11 18:17 12-01-2023_00:17-27.log

root@c4df08b5fb48:/config/www/nextcloud/apps# cat /config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/logs/12-01-2023_00:17-27.log
nohup: failed to run command '/config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/binaries/main': No such file or directory

andrey18106 · 2023-01-12T00:21:51Z

@timonline You missed to change one first :, it should be 12-01-2023_00-17-27.log, not 12-01-2023_00:17-27.log. Try again please.

timonline · 2023-01-12T00:22:05Z

@bigcat88

@timonline can you (or someone else with such problem) describe how we can reproduce this, what do specific your installations have which leads to situation where php cannot start binary file - looks like we miss something when rewriting code.

I mean i upgraded to nextcloud v25, install the cloud python api, installed mediadc, created a task, stayed pending. So i checked the log file and found the error.

Not sure there was anything special i did that reproduces the problem

EDIT: I even tried removing and reinstalling both multiple times

timonline · 2023-01-12T00:23:35Z

@andrey18106 don't see how i missed one.

root@c4df08b5fb48:/config/www/nextcloud/apps# grep "d-m-Y_H:i:s" ./cloud_py_api/lib/Service/PythonService.php

root@c4df08b5fb48:/config/www/nextcloud/apps# grep "d-m-Y_H:i-s" ./cloud_py_api/lib/Service/PythonService.php
				$logFile = $cwd . 'logs/' . date('d-m-Y_H:i-s', time()) . '.log';
				$logFile = $appDataDir . 'logs/' . date('d-m-Y_H:i-s', time()) . '.log';

andrey18106 · 2023-01-12T00:27:06Z

@timonline in both date('d-m-Y_H:i-s', time()) colon : symbol to -, should be date('d-m-Y_H-i-s', time())

bigcat88 · 2023-01-12T00:27:11Z

Can you describe what OS you are using, what type of Nextcloud installation you have, maybe some specific steps were followed to install php.
I don't understand why it can't run the command when the binary is present and has execute permissions.

timonline · 2023-01-12T00:29:59Z

to either @andrey18106 or @bigcat88 I am happy to jump on discord or some sort of chat to troubleshoot the problem live. Would be happy to find the exact circumstances that leads to a broken install as it took me a whole day of messing with pip and installing the prerequisites to get it to work.

There were MULTIPLE linux packages missing that I had to install to get the pip install -r requirements.txt to work because it kept erroring

timonline · 2023-01-12T00:30:25Z

@andrey18106

@timonline in both date('d-m-Y_H:i-s', time()) colon : symbol to -, should be date('d-m-Y_H-i-s', time())

root@c4df08b5fb48:/config/www/nextcloud/apps# cat /config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/logs/12-01-2023_00-31-43.log 
nohup: failed to run command '/config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/binaries/main': No such file or directory

root@c4df08b5fb48:/config/www/nextcloud/apps# ls -ltr /config/www/nextcloud/data/appdata_oceni1or87cb/mediadc/logs/
total 28
-rw-r--r-- 1 abc abc  128 Jan 11 15:34 11-01-2023_21:34:11.log
-rw-r--r-- 1 abc abc  128 Jan 11 15:47 11-01-2023_21:47:44.log
-rw-r--r-- 1 abc abc   49 Jan 11 16:26 11-01-2023_22:26:07.log
-rw-r--r-- 1 abc abc 3075 Jan 11 17:54 11-01-2023_22:27:11.log
-rw-r--r-- 1 abc abc  128 Jan 11 18:17 12-01-2023_00:17-27.log
-rw-r--r-- 1 abc abc  128 Jan 11 18:31 12-01-2023_00-31-08.log
-rw-r--r-- 1 abc abc  128 Jan 11 18:31 12-01-2023_00-31-43.log

timonline · 2023-01-12T00:36:19Z

@bigcat88

Can you describe what OS you are using, what type of Nextcloud installation you have, maybe some specific steps were followed to install php. I don't understand why it can't run the command when the binary is present and has execute permissions.

Nextcloud is a docker container from https://github.com/linuxserver/docker-nextcloud running on UnRaid whose base is

baseimage-alpine-nginx:3.15

Inside the docker when i run uname, i get this:

root@c4df08b5fb48:/config/www/nextcloud/apps# uname -r
5.19.17-Unraid

andrey18106 · 2023-01-12T00:38:43Z

@timonline ok, for your case, colon in logs paths not the issue, but in other cases it can be the reason. So, yea, it needs more investigation, discord is a good option.

timonline · 2023-01-12T00:40:34Z

@timonline ok, for your case, colon in logs paths not the issue, but in other cases it can be the reason. So, yea, it needs more investigation, discord is a good option.

I am at PhoenixCoder#4861 on discord

ghost · 2023-01-24T09:19:34Z

@timonline ok, for your case, colon in logs paths not the issue, but in other cases it can be the reason. So, yea, it needs more investigation, discord is a good option.

is there any progress on this?

bigcat88 · 2023-01-24T10:07:53Z

With what guide I can install Nextcloud AIO to get the same configuration that you have?
For all other reported cases we fixed this, it is the last case i think

ghost · 2023-01-24T10:19:10Z

With what guide I can install Nextcloud AIO to get the same configuration that you have? For all other reported cases we fixed this, it is the last case i think

# For x64 CPUs and without reverse proxy already in place:
sudo docker run \
--sig-proxy=false \
--name nextcloud-aio-mastercontainer \
--restart always \
--publish 80:80 \
--publish 8080:8080 \
--publish 8443:8443 \
--volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config \
--volume /var/run/docker.sock:/var/run/docker.sock:ro \
nextcloud/all-in-one:latest

then activate cloud_py_api and madiadc

teemue · 2023-01-25T11:11:09Z

For me tasks seem to remain pending until i restart them

ghost · 2023-01-25T12:30:31Z

For me tasks seem to remain pending until i restart them

unfortunately not for me

andrey18106 · 2023-01-25T19:18:07Z

@R7JANV1 Can you verify any errors in logs. Tasks run logs can be found here: /path/to/nextcloud/data/appdata_ncinstanceid/mediadc/logs/.

Have you tried usage from sources instead of pre-compiled binaries.

uribenshu · 2023-02-03T11:35:57Z

@andrey18106

I think the problem with linuxserver docker image is that the python and php binaries location is different than the default one in mediaDC settings: (I'm not sure !)

bigcat88 · 2023-03-13T21:50:47Z

Update cloud_py_api, uninstall mediadc, after that remove /path/to/nextcloud/data/appdata_ncinstanceid/mediadc folder, and install last mediadc.
Maybe it will work after that, need info about that.

dakeeper · 2023-09-19T09:10:46Z

any update for this?
i still have the "pending" bug.

andrey18106 added the bug Something isn't working label Jan 12, 2023

andrey18106 mentioned this issue Jan 14, 2023

Fix logs name colon symbol, fix binary hash check, fix musllinux detection. cloud-py-api/cloud_py_api#49

Merged

andrey18106 mentioned this issue Mar 13, 2023

Missing "configuration" tab as an administrator #122

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

task remains on Pending #101

task remains on Pending #101

ghost commented Jan 8, 2023

andrey18106 commented Jan 8, 2023

zainvegeta commented Jan 11, 2023

timonline commented Jan 11, 2023 •

edited

bigcat88 commented Jan 11, 2023 •

edited

timonline commented Jan 11, 2023

andrey18106 commented Jan 11, 2023

timonline commented Jan 11, 2023

bigcat88 commented Jan 11, 2023

andrey18106 commented Jan 11, 2023

timonline commented Jan 12, 2023 •

edited

andrey18106 commented Jan 12, 2023

timonline commented Jan 12, 2023 •

edited

timonline commented Jan 12, 2023

andrey18106 commented Jan 12, 2023

bigcat88 commented Jan 12, 2023

timonline commented Jan 12, 2023

timonline commented Jan 12, 2023 •

edited

timonline commented Jan 12, 2023 •

edited

andrey18106 commented Jan 12, 2023

timonline commented Jan 12, 2023

ghost commented Jan 24, 2023

bigcat88 commented Jan 24, 2023

ghost commented Jan 24, 2023

teemue commented Jan 25, 2023

ghost commented Jan 25, 2023

andrey18106 commented Jan 25, 2023

uribenshu commented Feb 3, 2023

bigcat88 commented Mar 13, 2023

dakeeper commented Sep 19, 2023

task remains on Pending #101

task remains on Pending #101

Comments

ghost commented Jan 8, 2023

andrey18106 commented Jan 8, 2023

zainvegeta commented Jan 11, 2023

timonline commented Jan 11, 2023 • edited

bigcat88 commented Jan 11, 2023 • edited

timonline commented Jan 11, 2023

andrey18106 commented Jan 11, 2023

timonline commented Jan 11, 2023

bigcat88 commented Jan 11, 2023

andrey18106 commented Jan 11, 2023

timonline commented Jan 12, 2023 • edited

andrey18106 commented Jan 12, 2023

timonline commented Jan 12, 2023 • edited

timonline commented Jan 12, 2023

andrey18106 commented Jan 12, 2023

bigcat88 commented Jan 12, 2023

timonline commented Jan 12, 2023

timonline commented Jan 12, 2023 • edited

timonline commented Jan 12, 2023 • edited

andrey18106 commented Jan 12, 2023

timonline commented Jan 12, 2023

ghost commented Jan 24, 2023

bigcat88 commented Jan 24, 2023

ghost commented Jan 24, 2023

teemue commented Jan 25, 2023

ghost commented Jan 25, 2023

andrey18106 commented Jan 25, 2023

uribenshu commented Feb 3, 2023

bigcat88 commented Mar 13, 2023

dakeeper commented Sep 19, 2023

timonline commented Jan 11, 2023 •

edited

bigcat88 commented Jan 11, 2023 •

edited

timonline commented Jan 12, 2023 •

edited

timonline commented Jan 12, 2023 •

edited

timonline commented Jan 12, 2023 •

edited

timonline commented Jan 12, 2023 •

edited