This short report brings to light some interesting commits to scylladb.git master from the last week. Commits in the 8ccee6803e9..d5efd1f6768 range are covered.
There were 378 non-merge commits from 43 authors in that period. Some notable commits:
The bundled cqlsh was updated to v6.0.34-scylla, fixing a vector type formatting bug.
Logstor is a new, experimental key/value storage engine. It now supports tablet split/merge and migration.
The license was updated to version 1.1, updating terms for non-commercial use.
One can now SELECT the WRITETIME and TTL of collection columns, not just scalar columns. One must specify an individual element.
Handling of prepared metadata ID was improved, increasing consistency of auth LIST statements.
Authentication of BATCH statements was improved.
In rare cases involving memory pressure, reversed queries could miss the latest version of the data. This is now fixed.
Hints sent by a replica that is being removed are now sent to all replicas.
LDAP URL parsing was made more robust.
An edge case where an error during tablet rebuild while altering the replication factor was fixed.
It is now possible to create a new vector index on a column while an old one is still available, as a way to adjust the index parameters.
A bug where tablet merge could not be finalized was fixed.
Speculative retry is now initiated faster if we know a replica is leaving the cluster.
The number of tablets in a table, and their boundaries, was relaxed from strict power-of-two rules. This prepares for vnode-to-tablet migration as well as other improvements.
Alternator is ScyllaDB’s implementation of the DynamoDB API. Alterantor requests are now fully audited, when enabled.
Commitlog segment replay order was fixed for some edge cases. This only has effect for strongly consistent tables, which are not production ready yet.
ScyllaDB records large partitions and large rows and allows the user to query them. These records are now stored in the sstables themselves, so the records are migrated when the sstable is migrated. The tables are now implemented as virtual tables.
The system.raft table is now encrypted.
Alterator, ScyllaDB’s implementation of the DynamoDB API, now supports CHILD_SHARDS filtering for DescribeStream requests.
Automatic vnode-to-tablets migration now makes use of the relaxed tablet count to support migration from clusters which were not specially prepared for it.
Alternator, ScyllaDB’s implementation of the DynamoDB API, now supports vector search.
The audit table, which is write heavy, now disables caching by default.
Compaction will now release garbage-collected sstables incrementally, improving memory and disk reclaim time.
Alternator, ScyllaDB’s implementation of the DynamoDB API, now supports Streams with tables that use tablets.
Vnodes-to-tablets migrations are now observable by the task manager APIs.
An edge case involving materialized view updates with range tombstones was fixed.
New clusters that use ms table format with Trie index will now also have higher selectivity for the primary index, reducing I/O bandwidth.
There is now a per-service-level metric for CQL concurrency.
The cluster now supports adding and removing datacenters for tables that use tablets.
Performance of audit was improved.
See you in the next issue of last week in scylladb.git master!