kafka

log

package log

Visibility
  1. Public
  2. All

Type Members

  1. case class CleanerConfig(numThreads: Int = 1, dedupeBufferSize: Long = 4.*(1024).*(1024L), dedupeBufferLoadFactor: Double = 0.9, ioBufferSize: Int = 1024.*(1024), maxMessageSize: Int = 32.*(1024).*(1024), maxIoBytesPerSecond: Double = scala.Double.MaxValue, backOffMs: Long = 15.*(1000), enableCleaner: Boolean = true, hashAlgorithm: String = "MD5") extends Product with Serializable

    Configuration parameters for the log cleaner

  2. class FileMessageSet extends MessageSet with Logging

    An on-disk message set.

  3. class Log extends Logging with KafkaMetricsGroup

    An append-only log for storing messages.

  4. case class LogAppendInfo(firstOffset: Long, lastOffset: Long, sourceCodec: CompressionCodec, targetCodec: CompressionCodec, shallowCount: Int, validBytes: Int, offsetsMonotonic: Boolean) extends Product with Serializable

    Struct to hold various quantities we compute about each message set before appending to the log

  5. class LogCleaner extends Logging with KafkaMetricsGroup

    The cleaner is responsible for removing obsolete records from logs which have the dedupe retention strategy.

  6. case class LogConfig(props: Map[_, _]) extends AbstractConfig with Product with Serializable

  7. class LogManager extends Logging

    The entry point to the kafka log management subsystem.

  8. class LogSegment extends Logging

    A segment of the log.

  9. class OffsetIndex extends Logging

    An index that maps offsets to physical file locations for a particular log segment.

  10. trait OffsetMap extends AnyRef

  11. case class OffsetPosition(offset: Long, position: Int) extends Product with Serializable

    The mapping between a logical log offset and the physical position in some log file of the beginning of the message set entry with the given offset.

  12. class SkimpyOffsetMap extends OffsetMap

    An hash table used for deduplicating the log.

Value Members

  1. object Defaults

  2. object FileMessageSet

  3. object Log

    Helper functions for logs

  4. object LogAppendInfo extends Serializable

  5. object LogConfig extends Serializable

  6. object LogFlushStats extends KafkaMetricsGroup

Ungrouped