This short report brings to light some interesting commits to scylla-cluster-tests.git master from the last week.
Commits in the 92febe89…447dff1e range are covered.
There were 27 non-merge commits from 8 authors in that period. Some notable commits:
Adjusting the replication factor for the system_auth keyspace is skipped when auth-v2 is enabled.
The latency decorator used in performance tests now also reports throughput stats, based on HDR files returned by cassandra-stress. These metrics are reported in Argus.
Before terminating a node during tests (e.g., decommissioning), SCT collects all its logs, similar to the collect-log CI stage. These logs are listed separately in Argus/show-logs, aiding in debugging terminated nodes.
The reuse cluster feature, which enables faster retry cycles, now has its own documentation, including configuration steps and usage examples.
Upgrade tests for different operating systems were sped up by limiting stress and focusing on ScyllaDB artifacts. Fully featured upgrade tests with high stress are reserved for crafted cloud images.
The result of latency_decorator_calculator can now be named dynamically, instead of using the function name. This enables storing results for different use cases of the same function (nemesis).
A new ‘gradual’ performance test was introduced, replacing both the simple latency and max throughput tests with less flakiness. It runs steps with varying fixed throughput, collecting latency based on HDR files, with the final step untrottled to determine max throughput. Results are reported in Argus and via email.
See you in the next issue of last week in scylla-cluster-tests.git master!