This short report brings to light some interesting commits to scylladb.git master from the last week. Commits in the 8c0920202bd..8ccee6803e9 range are covered.
There were 218 non-merge commits from 36 authors in that period. Some notable commits:
The system can now automatically migrate a table from vnodes to tablets. There are many restrictions currently, on the vnode token selection and on the features used by the table (e.g. LWT). These will be gradually lifted. Migration requires a rolling restart.
The system.size_estimates virtual table now correctly reflects data on all shards.
Alternator, ScyllaDB’s implementation of the DynamoDB API, contains an implementation of the Streams feature. It now generates correct Streams records for data inserted via BatchWriteItem.
The Raft core implementation now includes voters that are being demoted when a read barrier is performed during a configuration change.
Locking for staging sstables (during materialized view building) has been improved.
Some inconsistencies in DESCRIBE INDEX WITH INTERNALS have been fixed.
A race window where data written after repair was incorrectly marked as repaired was fixed.
Accounting of memory for large CQL responses has been improved.
The CREATE INDEX statement now support syntax compatible with Apache Cassandra Storage-Attached Index (SAI), for interoperability with third-party projects.
Tables using the COUNTER data type now have reduced storage usage, especially in environments with lots of tablet migrations or node bootstraps and decommissions.
The streaming scheduling group is disaggregated into several sub-groups under and overall maintenance super-group, allowing user-triggered compaction, streaming, and repair to be isolated from each other.
See you in the next issue of last week in scylladb.git master!