elasticsearchDiskSpaceMBwill scale automatically based on the disk space available to Elasticsearch in Kubernetes.
/opt/stackstate/etc/kafka-to-es/application.confusing the parameters described below.
diskSpaceWeightconfiguration parameter to adjust how available disk space is allocated across Elasticsearch index groups. This is helpful if, for example, you expect a lot of data to arrive in a single index. Below are some examples of disk space weight configuration.
diskSpaceWeightto 0 will result in no disk space being allocated to an index group. For example, if you are not going to use traces, then you can stop reserving disk space for this index group and make it available to other index groups with the setting:
elasticsearchDiskSpaceMB) will be allocated to index groups proportionally based on their configured
diskSpaceWeight. Disk space will be allocated to each index group according to the formula below, this will then be shared between the indices in the index group:
elasticsearchDiskSpaceMB = 300000, disk space would be allocated to the index groups and indexes be as follows: