Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DNM] matrix run test suite with legacy & tiered compaction #7748

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

problame
Copy link
Contributor

@problame problame commented May 14, 2024

Do not review.

refs #7749

Copy link

github-actions bot commented May 14, 2024

1048 tests run: 959 passed, 39 failed, 50 skipped (full report)


Failures on Postgres 15

  • test_fully_custom_config[tiered]: debug
  • test_branch_creation_before_gc[tiered]: debug
  • test_sharding_compaction[tiered-4-16]: debug
  • test_sharding_compaction[tiered-4-32768]: debug
  • test_sharding_compaction[tiered-None-None]: debug
  • test_fast_growing_tenant[tiered-absolute]: debug
  • test_fast_growing_tenant[tiered-relative_spare]: debug
  • test_partial_evict_tenant[tiered-relative_spare]: debug
  • test_partial_evict_tenant[tiered-absolute]: debug
  • test_partial_evict_tenant[tiered-relative_equal]: debug
  • test_actually_duplicated_l1[tiered]: debug
  • test_issue_5878[tiered]: debug
  • test_ondemand_download_large_rel[tiered]: debug
  • test_compaction_downloads_on_demand_without_image_creation[tiered]: debug
  • test_ondemand_download_timetravel[tiered]: debug
  • test_compaction_downloads_on_demand_with_image_creation[tiered]: debug
  • test_deletion_queue_recovery[tiered-no-validate-keep]: debug
  • test_deferred_deletion[tiered]: debug
  • test_deletion_queue_recovery[tiered-validate-keep]: debug
  • test_deletion_queue_recovery[tiered-validate-lose]: debug
  • test_deletion_queue_recovery[tiered-no-validate-lose]: debug
  • test_emergency_mode[tiered]: debug
  • test_eviction_across_generations[tiered]: debug
  • test_generations_upgrade[tiered]: debug
  • test_multi_attach[tiered]: debug
  • test_pageserver_init_node_id[legacy]: debug
  • test_pageserver_init_node_id[tiered]: debug
  • test_remote_storage_upload_queue_retries[tiered]: debug
  • test_timeline_deletion_with_files_stuck_in_upload_queue[tiered]: debug
  • test_sharding_split_compaction[tiered-compact-shard-ancestors-enqueued]: debug
  • test_sharding_split_compaction[tiered-compact-shard-ancestors-persistent]: debug
  • test_sharding_split_compaction[tiered-None]: debug
  • test_sharding_split_compaction[tiered-compact-shard-ancestors-localonly]: debug
  • test_delete_tenant_exercise_crash_safety_failpoints[tiered-real_s3-tenant-delete-before-shutdown-False-Check.RETRY_WITH_RESTART]: debug
  • test_compaction_induced_by_detaches_in_history[tiered]: debug
  • test_timeline_physical_size_post_gc[tiered]: debug
  • test_timeline_physical_size_post_compaction[tiered]: debug
  • test_vm_bit_clear_on_heap_lock[tiered]: debug
  • test_wal_backup[tiered]: debug
# Run all failed tests locally:
scripts/pytest -vv -n $(nproc) -k "test_fully_custom_config[debug-pg15-tiered] or test_branch_creation_before_gc[debug-pg15-tiered] or test_sharding_compaction[debug-pg15-tiered-4-16] or test_sharding_compaction[debug-pg15-tiered-4-32768] or test_sharding_compaction[debug-pg15-tiered-None-None] or test_fast_growing_tenant[debug-pg15-tiered-absolute] or test_fast_growing_tenant[debug-pg15-tiered-relative_spare] or test_partial_evict_tenant[debug-pg15-tiered-relative_spare] or test_partial_evict_tenant[debug-pg15-tiered-absolute] or test_partial_evict_tenant[debug-pg15-tiered-relative_equal] or test_actually_duplicated_l1[debug-pg15-tiered] or test_issue_5878[debug-pg15-tiered] or test_ondemand_download_large_rel[debug-pg15-tiered] or test_compaction_downloads_on_demand_without_image_creation[debug-pg15-tiered] or test_ondemand_download_timetravel[debug-pg15-tiered] or test_compaction_downloads_on_demand_with_image_creation[debug-pg15-tiered] or test_deletion_queue_recovery[debug-pg15-tiered-no-validate-keep] or test_deferred_deletion[debug-pg15-tiered] or test_deletion_queue_recovery[debug-pg15-tiered-validate-keep] or test_deletion_queue_recovery[debug-pg15-tiered-validate-lose] or test_deletion_queue_recovery[debug-pg15-tiered-no-validate-lose] or test_emergency_mode[debug-pg15-tiered] or test_eviction_across_generations[debug-pg15-tiered] or test_generations_upgrade[debug-pg15-tiered] or test_multi_attach[debug-pg15-tiered] or test_pageserver_init_node_id[debug-pg15-legacy] or test_pageserver_init_node_id[debug-pg15-tiered] or test_remote_storage_upload_queue_retries[debug-pg15-tiered] or test_timeline_deletion_with_files_stuck_in_upload_queue[debug-pg15-tiered] or test_sharding_split_compaction[debug-pg15-tiered-compact-shard-ancestors-enqueued] or test_sharding_split_compaction[debug-pg15-tiered-compact-shard-ancestors-persistent] or test_sharding_split_compaction[debug-pg15-tiered-None] or test_sharding_split_compaction[debug-pg15-tiered-compact-shard-ancestors-localonly] or test_delete_tenant_exercise_crash_safety_failpoints[debug-pg15-tiered-real_s3-tenant-delete-before-shutdown-False-Check.RETRY_WITH_RESTART] or test_compaction_induced_by_detaches_in_history[debug-pg15-tiered] or test_timeline_physical_size_post_gc[debug-pg15-tiered] or test_timeline_physical_size_post_compaction[debug-pg15-tiered] or test_vm_bit_clear_on_heap_lock[debug-pg15-tiered] or test_wal_backup[debug-pg15-tiered]"
Flaky tests (2)

Postgres 15

  • test_generations_upgrade[tiered]: debug
  • test_secondary_background_downloads[tiered]: debug

Test coverage report is not available

The comment gets automatically updated with the latest test results
b144f22 at 2024-05-28T17:30:13.261Z :recycle:

@problame problame force-pushed the problame/compaction-algorithm-matrix-run branch from c2536e3 to d9ce7f7 Compare May 14, 2024 11:05
Base automatically changed from problame/compaction-algorithm-env-var--take2 to main May 14, 2024 16:03
problame added a commit that referenced this pull request May 15, 2024
…propriate

Before this PR, the changed tests would overwrite the entire
`tenant_config` because `pageserver_config_override` is merged
non-recursively into the `ps_cfg`.

This meant they would override the `PAGESERVER_DEFAULT_TENANT_CONFIG_COMPACTION_ALGORITHM`,
impacting our matrix build for `compaction_algorithm=Tiered|Legacy` in
#7748.

I found the tests fixed in this PR using the
`NEON_PAGESERVER_PANIC_ON_UNSPECIFIED_COMPACTION_ALGORITHM` env var that
I added in #7748. Therefore, I think this is an exhaustive fix.
This is better than just searching the code base for `tenant_config`,
which is what I had sketched in #7747.

refs #7749
problame added a commit that referenced this pull request May 15, 2024
…propriate

Before this PR, the changed tests would overwrite the entire
`tenant_config` because `pageserver_config_override` is merged
non-recursively into the `ps_cfg`.

This meant they would override the `PAGESERVER_DEFAULT_TENANT_CONFIG_COMPACTION_ALGORITHM`,
impacting our matrix build for `compaction_algorithm=Tiered|Legacy` in
#7748.

I found the tests fixed in this PR using the
`NEON_PAGESERVER_PANIC_ON_UNSPECIFIED_COMPACTION_ALGORITHM` env var that
I added in #7748. Therefore, I think this is an exhaustive fix.
This is better than just searching the code base for `tenant_config`,
which is what I had sketched in #7747.

refs #7749
problame added a commit that referenced this pull request May 17, 2024
…propriate (#7771)

Before this PR, the changed tests would overwrite the entire
`tenant_config` because `pageserver_config_override` is merged
non-recursively into the `ps_cfg`.

This meant they would override the
`PAGESERVER_DEFAULT_TENANT_CONFIG_COMPACTION_ALGORITHM`, impacting our
matrix build for `compaction_algorithm=Tiered|Legacy` in
#7748.

I found the tests fixed in this PR using the
`NEON_PAGESERVER_PANIC_ON_UNSPECIFIED_COMPACTION_ALGORITHM` env var that
I added in #7748. Therefore, I think this is an exhaustive fix. This is
better than just searching the code base for `tenant_config`, which is
what I had sketched in #7747.

refs #7749
a-masterov pushed a commit that referenced this pull request May 20, 2024
…propriate (#7771)

Before this PR, the changed tests would overwrite the entire
`tenant_config` because `pageserver_config_override` is merged
non-recursively into the `ps_cfg`.

This meant they would override the
`PAGESERVER_DEFAULT_TENANT_CONFIG_COMPACTION_ALGORITHM`, impacting our
matrix build for `compaction_algorithm=Tiered|Legacy` in
#7748.

I found the tests fixed in this PR using the
`NEON_PAGESERVER_PANIC_ON_UNSPECIFIED_COMPACTION_ALGORITHM` env var that
I added in #7748. Therefore, I think this is an exhaustive fix. This is
better than just searching the code base for `tenant_config`, which is
what I had sketched in #7747.

refs #7749
@problame problame force-pushed the problame/compaction-algorithm-matrix-run branch from f171596 to bf46d69 Compare May 28, 2024 12:19
@problame problame force-pushed the problame/compaction-algorithm-matrix-run branch from bf46d69 to b144f22 Compare May 28, 2024 16:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant