Error on first startup after installation: "no such table: pretixmultidomain_knowndomain"

[c0de-bender]

Hi,

I'm trying to install pretix. After having some issues to install from source (see #3642), I now first tried to install via pip and see if I can get pretix to run. I'm having problems with that. The installation went without error, but when I open the website in the browser I'm getting an "Internal Server Error" and can see the following error in the logs:

django.db.utils.OperationalError: no such table: pretixmultidomain_knowndomain

(See below for the full error message.)

I checked the database and this table does exist in the database. This also means that pretix could connect correctly to the database during the initialization (migration) step.

Does someone have an idea why this occurs and what I have to do differently to fix it?

---

EDIT START: Solution

Problem solved: The cause was that I have my pretix configuration file in a custom location and the supervisor pretix service could not find this, because I didn't tell it where it was. The solution for me was to add the line
environment=PRETIX_CONFIG_FILE="%(ENV_HOME)s/pretix_installation/config/pretix.cfg"
to my supervisor service config file pretix.ini. See below for more details.

Note: During installation pretix did know where its config file was because I did
export PRETIX_CONFIG_FILE=$HOME/pretix_installation/config/pretix.cfg
in my .bash_profile. This doesn't get recognized by the supervisor service though (because it doesn't run a shell).

EDIT END

---

I searched other issues and found:

• Internal Server Error #3012
  The hint there was to check if the database tables got created. I checked it in my case and they are there.
• 502 Bad Gateway with fresh installation of docker image #1249
  The problem there was that the Postgres version was too old. My Postgres with version 15 should be fine.
• Internal Server Error after setup #1078
  No specific solution/hint there.

Background information

I installed pretix with the following commands (as the pretix user):

$ mkdir -p ~/pretix_installation/data
$ mkdir pretix_installation/config
$ cd pretix_installation
$ vi config/pretix.cfg        # create and populate pretix.cfg
$ python3.11 -m venv venv
$ source venv/bin/activate
(venv) $ pip install -U pip setuptools wheel gunicorn
(venv) $ pip install -U pretix==2023.8.0
(venv) $ python -m pretix migrate
(venv) $ python -m pretix rebuild
(venv) $ deactivate
$ vi ~/etc/services.d/pretix.ini        # create and populate pretix.ini
$ supervisorctl reread
$ supervisorctl update
$ supervisorctl status
$ crontab -e        # create a cronjob

I'm using the following configuration:

[pretix]
instance_name=<my_name>
url=<my_domain>
currency=EUR
datadir=/home/redacted/pretix_installation/data
trust_x_forwarded_proto=on

[locale]
default=en
timezone=Europe/Berlin

[database]
backend=postgresql
name=pretix_db
user=pretix_owner
password=...
host=localhost

[celery]
broker=redis+socket:///home/redacted/.redis/sock
backend=redis+socket:///home/redacted/.redis/sock

[mail]
from=<user-on-local-email-server>
host=<local-email-server>
user=<user-on-local-email-server>
password=...
port=587
tls=on

And this is my pretix.ini (supervisor is used on the system to manage services):

[program:pretix]
command=%(ENV_HOME)s/pretix_installation/venv/bin/gunicorn --reload --preload --bind 0.0.0.0:9000 --workers 2 pretix.wsgi --name pretix --max-requests 1200 --max-requests-jitter 50
directory=%(ENV_HOME)s/pretix_installation
autostart=true
autorestart=true
stopsignal=INT

[program:pretix_worker]
command=%(ENV_HOME)s/pretix_installation/venv/bin/celery -A pretix.celery_app worker -l info
directory=%(ENV_HOME)s/pretix_installation
autostart=true
autorestart=true
stopsignal=INT

This is the cronjob I created:

15,45 * * * * export PATH=/home/redacted/pretix_installation/venv/bin:\$PATH && cd /home/redacted/pretix_installation && python -m pretix runperiodic

Full error message

This is the full error message as I can see it in the supervisor logs.

2023-10-16 21:07:27,237 DEBG 'pretix' stderr output:
ERROR 2023-10-16 19:07:27,219 django.request log Internal Server Error: /
Traceback (most recent call last):
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/sqlite3/base.py", line 328, in execute
    return super().execute(query, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
sqlite3.OperationalError: no such table: pretixmultidomain_knowndomain

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/core/handlers/exception.py", line 55, in inner
    response = get_response(request)
               ^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/utils/deprecation.py", line 133, in __call__
    response = self.process_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/pretix/multidomain/middlewares.py", line 87, in process_request
    kd = KnownDomain.objects.select_related('organizer', 'event').get(domainname=domain)  # noqa
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 633, in get
    num = len(clone)
          ^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 380, in __len__
    self._fetch_all()
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 1881, in _fetch_all
    self._result_cache = list(self._iterable_class(self))
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 91, in __iter__
    results = compiler.execute_sql(
              ^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/sql/compiler.py", line 1562, in execute_sql
    cursor.execute(sql, params)
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 67, in execute
    return self._execute_with_wrappers(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
    return executor(sql, params, many, context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 84, in _execute
    with self.db.wrap_database_errors:
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/sqlite3/base.py", line 328, in execute
    return super().execute(query, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
django.db.utils.OperationalError: no such table: pretixmultidomain_knowndomain

2023-10-16 21:07:27,317 DEBG 'pretix' stderr output:
ERROR 2023-10-16 19:07:27,219 django.request log Internal Server Error: /
Traceback (most recent call last):
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/sqlite3/base.py", line 328, in execute
    return super().execute(query, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
sqlite3.OperationalError: no such table: pretixmultidomain_knowndomain

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/core/handlers/exception.py", line 55, in inner
    response = get_response(request)
               ^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/utils/deprecation.py", line 133, in __call__
    response = self.process_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/pretix/multidomain/middlewares.py", line 87, in process_request
    kd = KnownDomain.objects.select_related('organizer', 'event').get(domainname=domain)  # noqa
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 633, in get
    num = len(clone)
          ^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 380, in __len__
    self._fetch_all()
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 1881, in _fetch_all
    self._result_cache = list(self._iterable_class(self))
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/query.py", line 91, in __iter__
    results = compiler.execute_sql(
              ^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/models/sql/compiler.py", line 1562, in execute_sql
    cursor.execute(sql, params)
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 67, in execute
    return self._execute_with_wrappers(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
    return executor(sql, params, many, context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 84, in _execute
    with self.db.wrap_database_errors:
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/redacted/pretix_installation/venv/lib64/python3.11/site-packages/django/db/backends/sqlite3/base.py", line 328, in execute
    return super().execute(query, params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
django.db.utils.OperationalError: no such table: pretixmultidomain_knowndomain

There are also other (shorter) errors about a problem with the pretix_worker:

2023-10-16 21:07:11,082 DEBG 'pretix_worker' stderr output:
[2023-10-16 19:07:11,081: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 111] Connection refused.
Trying again in 18.00 seconds... (9/100)

[raphaelm]

What happens here is that somehow pretix does not try to connect to your postgres databsae but instead to a sqlite database, that is empty:

sqlite3.OperationalError: no such table: pretixmultidomain_knowndomain

A common cause would be your config file being in a location where pretix does not detect it. Try setting the environment variable PRETIX_CONFIG_FILE explicitly with the absolute path.

[c0de-bender]

Thanks for your quick reaction(s)!

Indeed, the problem was that pretix couldn't read the configuration file during startup. The reason is that I have a custom config file location and did export the environment variable in my .bash_profile correctly, but the supervisor service doesn't recognize this, hence it didn't know where to find the config file.

I also figured this out earlier this afternoon after reading your comment in #1078 again – this comment made me realize that pretix could read the configuration file during installation and database initialization, but not when it was started as a service. Sorry for not reporting back earlier, I didn't have time before now.

Here are more details of my setup, the cause of the error and the solution (maybe it helps other people in case they have the same problem):

1. I have my pretix configuration file in a custom location (namely ~/pretix_installation/config/pretix.cfg) which I wanted to set via the PRETIX_CONFIG_FILE environment variable.
2. To set the environment variable I did export PRETIX_CONFIG_FILE=$HOME/pretix_installation/config/pretix.cfg in my .bash_profile.
3. Because of this pretix could find the config file during installation in an interactive login shell.
4. However, the supervisor pretix service does not run a shell (see this supervisor GitHub issue comment) and hence does not source .bash_profile or .bashrc. Therefore PRETIX_CONFIG_FILE was not set and the pretix service didn't know about the location of the config file (see the pretix config file documentation for where it looks for the config file).

Solution

The solution for me was to add the line
environment=PRETIX_CONFIG_FILE="%(ENV_HOME)s/pretix_installation/config/pretix.cfg"
for each service in my supervisor pretix.ini:

[program:pretix]
environment=PRETIX_CONFIG_FILE="%(ENV_HOME)s/pretix_installation/config/pretix.cfg"
command=%(ENV_HOME)s/pretix_installation/venv/bin/gunicorn --reload --preload --bind 0.0.0.0:9000 --workers 2 pretix.wsgi --name pretix --max-requests 1200 --max-requests-jitter 50
directory=%(ENV_HOME)s/pretix_installation
autostart=true
autorestart=true
stopsignal=INT

[program:pretix_worker]
environment=PRETIX_CONFIG_FILE="%(ENV_HOME)s/pretix_installation/config/pretix.cfg"
command=%(ENV_HOME)s/pretix_installation/venv/bin/celery -A pretix.celery_app worker -l info
directory=%(ENV_HOME)s/pretix_installation
autostart=true
autorestart=true
stopsignal=INT

Now it works and I get the welcome page when I open the pretix site in the browser.

Don't forget the cronjob!

Note: The Pretix installation manual recommends to create a cronjob. This actually also needs to be notified about the configuration file location. This means that instead of

15,45 * * * * export PATH=~/pretix_installation/venv/bin:$PATH && cd ~/pretix_installation && python -m pretix runperiodic

I need to use the following cronjob:

15,45 * * * * export PRETIX_CONFIG_FILE=~/pretix_installation/config/pretix.cfg && export PATH=~/pretix_installation/venv/bin:$PATH && cd ~/pretix_installation && python -m pretix runperiodic

With an installation according to the Pretix docs, instead of

15,45 * * * * export PATH=/var/pretix/venv/bin:$PATH && cd /var/pretix && python -m pretix runperiodic

you'd need to use:

15,45 * * * * export PRETIX_CONFIG_FILE=<PATH_TO_YOUR_pretix.cfg> && export PATH=/var/pretix/venv/bin:$PATH && cd /var/pretix && python -m pretix runperiodic