eG Monitoring
 

Measures reported by AWSMSKClusteTest

AWS MSK Cluster uses Amazon EBS volume which is a durable, block-level storage device that you can attach to your instances. After you attach a volume to an instance, you can use it as you would use a physical hard drive. EBS volumes are flexible. Amazon EBS volume types that use burst performance, such as gp2, st1, and sc1, have a baseline performance depending on volume size. If your workload is driving I/O traffic to one of these volume types beyond its baseline performance, then burst credit gets spent.

This test helps the administrators to monitor whether/not the input-output burst balance is running out of credits for EBS volumes in the cluster such that the volume stops and no further reads or writes will occur until more credits are earned.

Outputs of the test: One set of results for each cluster executing in the target AWS Managed Service Kafka server.

Descriptor: Cluster

The measures made by this test are as follows:

Measurement Description Measurement Unit Interpretation
burstBalance Indicates the remaining balance of input-output burst credits for EBS volumes in the cluster. Number

Burst Balance is not reported for EBS volumes when the baseline performance of a volume is higher than the maximum burst performance.
messagesInPerSec Indicates the rate at which the messages are incoming to the broker. Messages/Sec

 
dataInPerSec Indicates the average rate at which data sent from producers is consumed by the broker. MB

 
dataOutPerSec Indicates the average rate at which data is fetched and read from the broker. MB

 
kafkaAppLogsDiskUsed Indicates the percentage of disk space used for application logs. Percent

 
leaderCount Indicates the number of replicas for which this broker is the leader. Number

 
partitionCount Indicates the number of partitions in the broker. Number

 
requestBytesMean Indicates the amount of data received during the last measurement period. MB

 
requestTime Indicates the total amount of time taken for reading the request and sending the result. Seconds

 
rootDiskUsed Indicates the percentage of the root disk used by the broker. Percent

 
swapFree Indicates the size of swap memory that is available for the broker. MB

 
swapUsed Indicates the size of swap memory that is in use for the broker. MB

 
underMinIsrPartitionCoun Indicates the number of partitions under the minimum In-Sync Replica (ISR) count. Number

The ISR count indicates the set of replicas that are up-to-date with the leader.
underReplicatedPartition Indicates the number of partitions that have not been fully replicated in the follower replicas. Number

 
bwInAllowanceExceeded Indicates the number of packets shaped because the inbound aggregate bandwidth exceeded the maximum for the broker. Number

 
bwOutAllowanceExceeded Indicates the number of packets shaped because the outbound aggregate bandwidth exceeded the maximum for the broker. Number

 
ppsAllowanceExceeded Indicates the number of packets shaped because the bidirectional PPS exceeded the maximum for the broker. Number

 
requestHandlerAvgIdlePer Indicates the average percentage of the time the request handler threads are idle. Percent