Plausible is fetching MaxMind GeoIP databases too often #4042
Replies: 2 comments · 7 replies
-
Could you please check your docker compose logs to see if Plausible is restarting? |
Beta Was this translation helpful? Give feedback.
All reactions
-
Unfortunately it has started to crash and restart over and over again :( The clickhouse and postgres containers are fine; no errors in there. But Plausible logs the messages above and keeps quitting and restarting. |
Beta Was this translation helpful? Give feedback.
All reactions
-
@perfectly-preserved-pie please post full logs for the last session (when it was going smoothly at first and then started to have problems) for all services (including PostgreSQL and ClickHouse). And also please post your docker-compose.yml and describe your host (OS, Docker version, anything else relevant). |
Beta Was this translation helpful? Give feedback.
All reactions
-
@madanyang we use locus for geo lookups. Here's the description of the DB update flow https://github.com/g-andrade/locus#remote-sources-downloading-and-updating If you are not experiencing 429 errors, I don't think changing |
Beta Was this translation helpful? Give feedback.
All reactions
-
@ruslandoga now at least I know the where this 6 hr interval is coming. While I agree if aint' broke don't fix it approach, the same approach also prevents user controllable variables like update frequency which was available when using maxmind docker. So for me this is a feature request. |
Beta Was this translation helpful? Give feedback.
All reactions
-
Plausible:
Clickhouse: Merging configuration file '/etc/clickhouse-server/config.d/docker_related_config.xml'.
Logging trace to /var/log/clickhouse-server/clickhouse-server.log
Logging errors to /var/log/clickhouse-server/clickhouse-server.err.log
Processing configuration file '/etc/clickhouse-server/config.xml'.
Merging configuration file '/etc/clickhouse-server/config.d/docker_related_config.xml'.
Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'.
Processing configuration file '/etc/clickhouse-server/users.xml'.
Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. Postgres:
docker-compose.yml:
I'm running Ubuntu 22.04 LTS and Docker version 26.1.0, build 9714adc. |
Beta Was this translation helpful? Give feedback.
All reactions
-
I got the same email yesterday. It's because I have a second server for making queries, but that server is only active on demand. So, every time it wakes up, it downloads another db from maxmind. At least, it should be limited to only download a db once per day, not every time plausible starts. |
Beta Was this translation helpful? Give feedback.
-
I just got this email from Maxmind:
And looking at my download history in my MaxMind account, it seems Plausible is fetching the same exact database quite frequently:
This frequency is unnecessary because MaxMind updates their databases on a regular schedule, every Tuesday and Friday.
Could there be a new environment variable added, perhaps
MAXMIND_UPDATE_FREQUENCY
, that we could use to dictate when Plausible should fetch a new database from MaxMind to avoid hitting the download limits of a free account?Or, does anyone have other suggestions to work around this? Could this be a problem with my installation?
Beta Was this translation helpful? Give feedback.
All reactions