I have configured this property delete.retention.ms at the time of creating topic in kafka on 0.8.1 version.What this property does ? Will this delete message after the specific time interval from kafka.
1 Answer
No, delete.retention.ms or log.cleaner.delete.retention.ms is a property used in log compaction which is turned off as a default.log.rentention.hours is a property that you can control when messages are deleted.
From Broker Configs of Kafka 0.8.1 documentation
log.retention.hours
The amount of time to keep a log segment before it is deleted, i.e. the default data retention window for all topics. Note that if both log.retention.minutes and log.retention.bytes are both set we delete a segment when either limit is exceeded.
log.cleaner.delete.retention.ms
5The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage (otherwise delete tombstones may be collected before they complete their scan).
