Kafka Log Compaction Configuration
Kafka Log Compaction Configuration . You can achieve this by setting two additional properties from the advanced configuration, or a corresponding value for an individual topic:. This tutorial is to demonstrate how log compaction works in apache kafka. Log Compaction Highlights in the Apache Kafka and Stream Processing from www.confluent.io If you set min.compaction.lag.ms config bigger than 0, then any segment that has a record with a timestamp younger than this config, will not. Logs cleaning, which by the way can be disabled with log.cleaner.enable property, is managed by logmanager class. Kafka log compaction allows consumers to regain their state from the compacted topics.