Last week in scylla-cluster-tests.git master (issue #31; 2023-12-09)

This short report brings to light some interesting commits to scylla-cluster-tests.git master from the last 3 weeks. Commits in the 91aec87b…7c7279b7 range are covered.

There were 76 non-merge commits from 13 authors in that period. Some notable commits:

Exposed shard-aware ports in AWS security group fixing issue with running tests from local machine with backend on AWS.

We added 2 CI multidc jobs for the EKS backend - 3 and 12 hours long.

New util for decoding kallsyms It can be called from command line as follow:

./utils/decode_kallsyms.py  -i ~/Desktop/system.log -k ~/Desktop/kallsyms_20231114_000857

Scylla-Manager now works in MultiDC K8S tests.

SCT supports MultiDC on GKE backend and 2 AWS-like tests were added.

In scylla-operator-v1.11.0 was added the possibility to gather K8S logs by using it’s binary. It is required for support requests and bug reports. ‘must-gather’ operator command is now used in SCT to gather these logs to a separate archive.

SCTConfiguration class now can detect the scylla version early with get_version_based_on_conf method. We can use this information for test configuration before db nodes are up.

Argus now collects and presents SCT version based on git repository details: url, branch, sha.

latte is a rust base stress tool that works with scylla rust driver, it claimed to be faster and more efficient than cassandra-stress NoSQLBench, and tlp-stress. We introduced support for it and can stress Scylla using this tool.

From time to time we upgrade Node exporter, which is in charge of OS metrics from Scylla nodes. Now we check it’s availability in artifact tests.

SCT enables user encryption by default when the test is configured with KMS - which is enabled by default if enterprise and AWS.

“EndOfQuotaNemesis” was created.. This Nemesis is configuring XFS quota for scylla user on a Scylla node and verifies proper handling of this error.

When testing on the Docker backend we can now set specific docker network, this enables testing with components that are started with docker-compose (e.g. Kafka).

See you in the next issue of last week in scylla-cluster-tests.git master!