Detail
As tombstones consume Primary Index space in memory or device, is there a way to clear tombstones manually without the intervention of tomb-raider?Answer
The tombstones will be eligible to be deleted by the tomb-raider only when there are no previous copies of the record on disk. The tomb-raider still needs to run as part of the clean up.To accelerate removal of previous copies of the record on disk, the storage devices could be wiped clean with dd or blkdiscard . This would require the service to be stopped and restarted and for records/tombstones to migrate back to the node from a replica. The same procedure would need to be done on the replica node once migrations have completed.
A more detailed knowledge-base on removing tombstones faster can be found here:
https://support.aerospike.com/s/article/How-to-recover-tombstones-faster
Notes
- Tomb-raider removes tombstones which are no longer needed. The conditions for a tombstone to be removed are as follows:
- There are no previous copies of the record on disk.
- The tombstone's last-update-time is before the current time minus the configured tomb-raider-eligible-age.
- The node is not waiting for any incoming migration.
- The tombstone has been successfully shipped by XDR (if using XDR 5.0 and above).