How to prevent RR from trying to process event ?

[QuietImprovement]

Hi, I'm using RR with Job configuration, but I want to use it only to send messages to SQS.

The problem is that RR is trying to process any message placed in the queue, in an infinite loop...

2024-03-07 15:23:06 Missing RR worker implementation for jobs mode

[rustatian]

Hey @QuietImprovement 👋

1. What is your RR version + configuration.
2. Logs (because that log entry is not from the RR).
3. Do you use ->complete() method inside the PHP Worker?

[QuietImprovement]

Hi @rustatian ,

The config that I use, and the version is v2023.3.12

version: "3"

rpc:
  listen: "tcp://127.0.0.1:6001"

server:
  command: "php public/index.php"
  env:
    - APP_RUNTIME: Baldinof\RoadRunnerBundle\Runtime\Runtime

http:
  address: 0.0.0.0:8080
  middleware: ["static", "gzip"]
  uploads:
    forbid: [".php", ".exe", ".bat"]
  static:
    dir: "public"
    forbid: [".php"]
  pool:
    max_jobs: 1
    num_workers: 2
    supervisor:
      max_worker_memory: 128
      exec_ttl: 20s
      idle_ttl: 120s
      ttl: 3600s
      destroy_timeout: 60s
      watch_tick: 30s

sqs:
  key: key
  secret: secret
  region: us-east-2	
  endpoint: http://localstack:4566
jobs:
  num_pollers: 0
  pipeline_size: 100000
  pool:
    num_workers: 0
    max_jobs: 0
    debug: true
  consume: ["queue-name"]
  pipelines:
    queue-name:
      driver: sqs
      config:
        prefetch: 0
        consume_all: true
        skip_queue_declaration: true
        queue: queue-name

logs:
  encoding: console
  level: debug
  mode: development
  err_output: stderr
  output: stderr

  channels:
    http:
      level: debug
    server:
      level: debug
      mode: raw

2. So I think this log is coming from Baldinof\RoadRunnerBundle

3. I think complete is not used, HttpWorker.php

[rustatian]

1. Your http config contains option max_jobs: 1 which leads worker to restart every request, which is super inefficient.
2. Your jobs config works in the debug mode, which will create a worker on every request, which also should be used only locally.
3. To complete the job, you have to ask RR to acknowledge it: https://github.com/roadrunner-php/jobs?tab=readme-ov-file#consumer

[QuietImprovement]

@rustatian Thank you for the clarification, another question please,

<?php
while ($task = $this->rrConsumer->waitTask()) {
            try {
                doTheJob()...
                $task->complete();
            } catch (AException $exception) {
                $task->fail($exception);
            } catch (BException | Throwable $exception) {
                $task->fail($exception, self::SHOULD_BE_RETRIED);
            }
        }

In case of exception/fail, the message didn't move to deadletter queue, the fail function should do that, no ?

[rustatian]

RR doesn't use dead-letter queue for the SQS driver. However, if you need to retry your message, just use requeue: true option of the fail method: https://docs.roadrunner.dev/queues-and-jobs/overview-queues#task-failing.
Among with the failed task, you may send any number of custom headers to control retries (number of retries, for example). The original message headers would be updated with the new one. Moreover, only after RR successfully pushed the updated message to the original SQS queue, the old one would be deleted. So, RR has at-least-once delivery guarantee.