Word and Character Counter
0 words, 0 characters
Popular Posts
Projects
3/Business/post-list
Subscribe Us
Copyright © by askcode.org | All rights reserved |
Search This Blog
Created By Blogspot | Distributed By Gooyaabi Template
1 Comments
I am running Kafka Streams Applications on the same machines where my Kafka Brokers are running.
ReplyDeleteFew millions of records are consumed/produced every hour. Whenever I take any kafka broker down, it goes into rebalancing after rebalancing many times it starts consuming very old messages.
Note: When Kafka Streams Application was running fine, lag was nearly 0. But after rebalancing lag went from 0 to 10million.
Can these be because of offset.retention.minutes.
Kafka Broker log & offset retention policy: log retention policy - 3 days offset.retention.minutes - 1 day