Kafka Replays Messages Over And Over - Heartbeat Session Expired - Marking Coordinator Dead

Using python kafka api to read messages from a topic with only a handful of messages in it. Kafka keeps on replaying the messages in the queue over and over again. It receives a me

Solution 1:

Seems like you need to tune your consumer configuration , most likely looking the logs it seems that the consumer's heartbeat session is expiring and it is unable to commit the last polled records due to expired session and it is triggering the rebalance so it will poll again from last uncommitted record

Config to check -

• heartbeat.interval.ms
• session.timeout.ms
• max.poll.interval.ms