This short report brings to light some interesting commits to scylladb.git master from the last week. Commits in the 53b98a8610…2ad13e5d76 range are covered.
There were 109 non-merge commits from 23 authors in that period. Some notable commits:
INSERT JSON now understands more complex data types when used as keys.
The ScyllaDB source code now bundles the abseil library (again), as new versions of abseil cannot be used from distribution packages.
The hinted handoff code now uses host IDs instead of IP addresses. This conforms with consistent topology, which uses host IDs throughout.
A bug related to the cluster’s view of the cluster size during upgrade to consistent topology has been fixed.
Change Data Capture (CDC) maintains a history of the cluster topology to allow clients to fetch older change records. This history is now pruned earlier to reclaim space.
We will avoid running migrations from auth tables if we’re already using Raft based auth tables.
During compaction, all cell timestamps are relative to a base timestamp. We now exclude fully expired sstables from calculation of the base timestamp, in order to get a more accurate base.
The failure detector’s ping timeout is now tunable.
The system.large_partitions table now includes a column for the number of deleted rows.
Tables that use tablets will now reject lightweight transactions (LWTs) as they are still not implemented.
The REST API now understands the special table names used to back alternator local secondary indexes.
ScyllaDB caches a queries that have been paused by the paging mechanism so the next page can be fetched more efficiently. It will now drop cached queries when the tablet they refer to has been migrated.
Recently, ScyllaDB started to drop Bloom filters when they use up too much space. It will now reload them when space is available again, for example due to compaction.
ScyllaDB estimates a compaction’s partition count in order to correctly size the bloom filter. It will now improve the estimate for garbage collection sstables.
See you in the next issue of last week in scylladb.git master!