Breaking News: Grepper is joining You.com. Read the official announcement!

how to check number of messages in kafka topic

Priyanshu answered on October 13, 2020 Popularity 8/10 Helpfulness 2/10

answer how to check number of messages in kafka topic

how to check number of messages in kafka topic

Comment

brokers="<broker1:port>"
topic=<topic-name>
sum_1=$(/usr/hdp/current/kafka-broker/bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list $brokers --topic $topic --time -1 | grep -e ':[[:digit:]]*:' | awk -F  ":" '{sum += $3} END {print sum}')
sum_2=$(/usr/hdp/current/kafka-broker/bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list $brokers --topic $topic --time -2 | grep -e ':[[:digit:]]*:' | awk -F  ":" '{sum += $3} END {print sum}')
echo "Number of records in topic ${topic}: "$((sum_1 - sum_2))

Popularity 8/10 Helpfulness 2/10 Language java

Source: stackoverflow.com

Tags: java kafka-topic messages

Link to this answer
Share Copy Link