Health synchronization
StackState Self-hosted v5.1.x
Last updated
StackState Self-hosted v5.1.x
Last updated
Health synchronization adds existing health checks from external monitoring systems to StackState topology elements. Health data is calculated in the external monitoring system using its own data and rules, then automatically synchronized and attached to the associated topology elements in StackState.
The StackState Receiver API will automatically receive and process all incoming health data. StackState doesn't require additional configuration to enable health synchronization, however, the health data received should match the expected JSON format.
Details on how to ingest health data can be found on the following pages:
The health synchronization framework works as follows:
Health data is sent to StackState and ingested via the Receiver API.
StackState topology elements related to the ingested health checks are identified and bound based on:
the obtained during topology synchronization.
the topologyElementIdentifier
from the ingested .
StackState keeps track of changes to both topology elements and health checks to maintain up-to-date information.
The REPEAT_SNAPSHOTS
consistency model works with periodic, full snapshots of all checks in an external monitoring system. StackState keeps track of the checks in each received snapshot and decides if associated external check states need to be created, updated or deleted in StackState. For example, if a check state is no longer present in a snapshot. This model offers full control over which external checks will be deleted as all decisions are inferred from the received snapshots. There is no ambiguity over the external checks that will be present in StackState.
Use this model when: The external monitoring system is capable of keeping the state of which elements are present in a determined time window and therefore can communicate how the full snapshot looks like.
External monitoring systems send health data to the StackState Receiver in a health stream. Each health stream has at least one substream with health checks.
The Health stream uniquely identifies the health synchronization and defines the boundaries within which the health check states should be processed together.
The expire interval can be used to configure sub streams in the health synchronization to delete data that isn't sent by the external system anymore. This is helpful in case the source for a substream could be decommissioned and StackState would not hear from it again. Without an expire interval, the previously synchronized data would be left permanently hanging.
StackState health synchronization relies on different consistency models to guarantee that the data sent from an external monitoring system matches with what StackState ingests and shows. The consistency model is specified in the "health"
property of the or as an argument in the StackState CLI when health data is sent to StackState. The supported models are: REPEAT_SNAPSHOTS
, REPEAT_STATES
and TRANSACTIONAL_INCREMENTS
.
JSON payload: The accepts specific properties to specify when a snapshot starts or stops.
JSON payload: The accepts specific properties to specify the expiry configuration.
JSON payload: The metadata repeat_interval
and expire_interval
aren't relevant for the as there is no predefined periodicity on the data.
Sub streams contain the health check data that are processed by StackState. When working with health data from a distributed external monitoring system, multiple sub streams can be configured, each containing health snapshots from a single location. The data in each substream is semi-independent, but contributes to the health check states of the complete health stream. If a single location is responsible for reporting the health check states of the health stream, you can omit the sub_stream_id
from the . StackState will assume that all the external health checks belong to a single, default substream.
Health synchronization processes the ingested health data per substream. The repeat interval specified in the is the commitment from the external monitoring system to send complete snapshots over and over to keep the data up to date on StackState. This is helpful for StackState to be able to inform the user how up to date the health synchronization is running.
The health check state is calculated by an external monitoring system and includes all information required to attach it to a topology element. Once attached to a topology element, the health check state contributes to the .