I see that parameter enable_sstable_data_integrity_check can control whether to enable integrity checks on SSTables. Its default value is false, and turning it on will have an impact on performance. I saw its implementation in the commit of sstables: introduce file interposer for integrity check . I…

It has a decent impact on performance. It’s not recommended to enable it by default for a production cluster / node. In case of a severe issue, a ScyllaDB developer may suggest to enable temporarily this in order to do some validations to the sstable. If you want to have sstables integrity check …

The best way to get integrity checking for your data on disk is to enable Sstable compression, when creating your tables (can be enabled later via alter table as well). Sstable compression stores checksums next to the data in the Sstable data file, and these checksums are checked every time the data…

Hi！ I saw the addition of function scylla sstable scrub in 5.4, what is the difference between it and function nodetool scrub ? Currently, this only checks checksums on compressed sstables And what is the meaning of compressed sstables? Thanks!

I saw the addition of function scylla sstable scrub in 5.4, what is the difference between it and function nodetool scrub ? scylla-sstable scrub is just an off-line version of nodetool scrub, meaning that you don’t need a running ScyllaDB process to do the scrub. The use-case this was developed f…

If you want to have sstables integrity check once in a while, you can use “nodetool scrub” command with its options. Hi, I would like to know what impact my long-term continuous scheduling of nodetool scrub will have on the cluster? Does it have the same impact on the cluster as compaction? Becau…

Yes, scrub is just a type of compaction and it will have the same effect as an ongoing compaction.

How do you use Scrub in production to ensure data security? If I schedule repairs during the cycle, is it still necessary to schedule Scrub?

@bo_li please start a new discussion for follow up questions. That would make it easier for other community members to find.

Currently we only use scrub we we identify bad sstables, that scrub is able to fix. We also use nodetool scrub --mode=VALIDATE, to find bad sstables. Currently the scrub is quite limited in what it can fix and identify. But we have plans to develop scrub to be more capable, in detecting bad sstables…

What is the impact of starting the data integrity check of the SStable file on the cluster？

ScyllaDB

bo_li March 8, 2024, 6:11am 11

ok， I have started another topic here.

1 Like

Topic		Replies	Views
Last week in scylladb.git master (issue #257; 2024-11-24) ScyllaDB git-news	0	40	November 24, 2024
In what scenario will `nodetool scrub` be used? ScyllaDB nodetool , sstable	1	258	March 8, 2024
Last week in scylladb.git master (issue #185; 2023-06-25) ScyllaDB git-news	0	252	June 25, 2023
ScyllaDB Enterprise Release 2023.1.0 - Part 3 Release Notes enterprise , enterprise-release , enterprise-2023-1	0	526	August 21, 2023
[RELEASE] ScyllaDB 5.4.0 - Part 3 - Monitoring, Tools, Performance, Stability and more Release Notes open-source , open-source-release , open-source-5-4	0	967	December 6, 2023

What is the impact of starting the data integrity check of the SStable file on the cluster？

Related topics