How to merge large PDF?

[knebb]

Hi,
running paperless-ngx on docker on a Debian VM.

I have a really huge document (text, sketches) of 300 pages. I scanned this in parts and was thinking to merge it afterwards in paperless-ngx.

Unfortunately, this is not going to work :(
At first I had memory issues:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/billiard/pool.py", line 1264, in mark_as_worker_lost
    raise WorkerLostError(
billiard.exceptions.WorkerLostError: Worker exited prematurely: signal 9 (SIGKILL) Job: 2.

So I changed the VMs settings to have 20G of RAM and 10G of swapspace and 4 vCPUs. 8)
Now I am getting a different error:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/billiard/pool.py", line 683, in on_hard_timeout
    raise TimeLimitExceeded(job._timeout)
billiard.exceptions.TimeLimitExceeded: TimeLimitExceeded(1800,)

Looks like there is some hard coded timeout. :(

Do I have a chance to merge these documents and integrate them into Paperless in some way?

[EDIT] With the help of pdfunite I was able to merge the documents. Now I have a single 164MB pdf-file. I assume just trying to consume will give the same errors in Paperless?

Thanks!
/KNEBB

[stumpylog]

The task time is configurable: https://docs.paperless-ngx.com/configuration/#PAPERLESS_WORKER_TIMEOUT

[github-actions[bot]]

This discussion has been automatically closed because it was marked as answered. Please see our contributing guidelines for more details.