Use proper process manager for backend background services

[RealOrangeOne]

Running RQ as an unsupervised background process is dangerous, as there's nothing monitoring its availability.

Instead, it should either run as a separate container, or use a proper process manager like s6 inside the container to watch both processes.

[sickelap]

We are considering Django Q2 to replace Redis RQ. With that, we would be able to use other backend DBs in different scenarios.

[RealOrangeOne]

That won't fix the issue. The problem isn't needing a separate Redis instance. The problem is running rq_worker in a child process and not monitoring it.

[sickelap]

I see what you mean. Yea, switching the engine won't solve the issue you are describing. There are other "services" that are spawned within the container.
Extracting RQ to another container seems overkill, s6 looks promising, though.

[RealOrangeOne]

Ah, I'd missed those - those should probably be moved to process manager.