Skip to main content

Posts

Showing posts from October, 2018

Kafka Topic Storage

In Kafka, a topic is a category or feed name to which records are published. Topics in Kafka are always multi-subscriber; that is, a topic can have zero, one, or many consumers that subscribe to the data written to it.


Each partition is an ordered, immutable sequence of records that is continually appended to—a structured commit log. The records in the partitions are each assigned a sequential id number called the offset that uniquely identifies each record within the partition.



The only metadata retained on a per-consumer basis is the offset or position of that consumer in the log.