Cassandra Vs ScyllaDB Memory Usage

ScyllaDB
,
1

I am doing performance comparisons of ScyllaDB and Cassandra, specifically looking at the impact of memory. The machines I am using each have 16GB and 8 cores. Based on the docs, Cassandra will default to 4GB Xmx and use the remaining 12GB as file system cache. ScyllaDB instead will use all 16GB for itself.

What I’m wondering is if this is a fair comparison setup (4GB Xmx for Cassandra vs 16GB for Scylla)? I realize this is what each recommends, but would a more fair test be 8GB Xmx for Cassandra and --memory 8G for ScyllaDB? My workload is mostly write intensive, and I don’t expect file system caching to always be able to help Cassandra. It’s odd to me that ScyllaDB does not expect almost any file system caching compared to Cassandra’s huge reliance on it.

*The question was asked on Stack Overflow by Riley Zimmerman

2

Scylla will use ~1/2 of the memory for MemTable, and the other half for Key/Partition caching. If your workload is mostly write, more memory will have less of an effect on performance and should be bounded by either I/O or CPU.

I would recommend reading: Learn about different I/O Access Methods and what we chose for ScyllaDB
to understand the way Scylla is writing information, and ScyllaDB Workload Conditioning part one: write request rate determination To understand the way Scylla is balancing I/O workloads

*The answer was provided on Stack Overflow by gutkinde

3

Cassandra will always use all of the system memory; the heap size (-Xmx) setting just determines how much is used by the heap and how much by other memory consumers (off-heap structures and the page cache). So if you limit Scylla’s memory usage, it will be at a disadvantage compared to Cassandra.

*The answer was provided on Stack Overflow by Avi Kivity