Last week in scylla-cluster-tests.git master (issue #55; 2024-07-12)

This short report brings to light some interesting commits to scylla-cluster-tests.git master from the last week. Commits in the 909a185e…75d03380 range are covered.

There were 19 non-merge commits from 5 authors in that period. Some notable commits:

Debian10 is deprecated as of June 30, 2024, and we have removed all jobs based on it.

We’ve introduced the perf_extra_jobs_to_compare test parameter, which enables comparison of staging performance jobs with others (e.g., weekly jobs). This feature is also available in the hydra perf-regression-report command for manual report creation when needed.

We now cache pull request details for the SkipPerIssues utility since tests are sometimes skipped based on PRs rather than issues.

KMS is enabled by default for enterprise tests. To disable it, set the enterprise_disable_kms test parameter to true.

We encountered issues with dropped SSH connections for long-running commands. The run_nodetool method now has a long_running feature to address this by running nodetool in the background on the remote host and periodically checking its status. This feature has been enabled in several nemeses.

For certain cases, like parallel nemeses, we don’t want to fail a test based on an error event alone. Instead, we look for coredumps or critical-level events. A new teardown-validator was introduced to determine test failure based on predefined error events only. This has been enabled in the longevity-2TB-48h-authorization-and-tls-ssl-1dis-2nondis-nemesis test.

See you in the next issue of last week in scylla-cluster-tests.git master!