Data retention

Configuring data retention parameters.

StackState imposes data retention limits to save storage space and improve performance. You can configure the data retention period to provide a balance between the amount of data stored, StackState performance, and data availability.

Retention of topology graph data

By default topology graph data will be retained for 8 days. This works in a way that the latest state of topology graph will always be retained; only history older than 8 days will be removed. You can check and alter the configured retention period this using the StackState CLI.

# Check the current retention period
sts graph retention get-window

In some cases, it may be useful to keep historical data for more than eight days.

# Set the configured retention period to 10 days
sts graph retention set-window --window 864000000

(note that time value is provided in milliseconds - 10 days equals 864000000 milliseconds)

Please note that by adding more time to the data retention period, the amount of data stored is also going to grow and need more storage space. This may also affect the performance of the Views.

After the new retention window is applied, you can schedule a new removal with this command:

# Schedule a new removal
sts graph retention set-window --schedule-removal

After changing the retention period to a smaller window, you may end up with some data that is already expired and will wait there until the next scheduled cleanup. To schedule an additional removal of expired data, use the following command:

Please note that this may take some time to have an effect.

# Schedule removal of expired data
sts graph retention remove-expired-data

However, if you would like to perform data deletion without having to wait for an additional scheduled cleanup, you can use --immediately argument:

# Remove expired data immediately
sts graph retention remove-expired-data --immediately

Retention of metrics/events

If you are using the metric/event store provided with StackState, your data will be retained for a month. If you have configured your own data source to be accessed by StackState, the retention policy is determined by the metric/event store you connected.