Class | Description |
---|---|
DownloadTieredObject |
A utility tool to download a tiered objects.
|
DumpTierPartitionState | |
InspectTieredObjects |
/opt/confluent/bin/kafka-run-class kafka.tier.tools.InspectTieredObjects --help
usage: kafka.tier.tools.InspectTieredObjects
[-h] --log.dir LOG.DIR --start.offset START.OFFSET --end.offset END.OFFSET [--tier.config TIER.CONFIG] [--get {true,false}] [--logging.level LOGGING.LEVEL]
Provides a facility to check the existence or to download tiered objects
optional arguments:
-h, --help show this help message and exit
--log.dir LOG.DIR Fully qualified path for log directory where tier state file is located
--start.offset START.OFFSET
Start offset for the range of tiered objects to be inspected
--end.offset END.OFFSET
End offset for the range of tiered objects to be inspected
--tier.config TIER.CONFIG
The path to a configuration file containing the required properties (default: /mnt/config/kafka.properties)
--get {true,false} Indicates whether the said range of objects need to be downloaded (max 5) (default: false)
--logging.level LOGGING.LEVEL
Logging level for the tool (default: INFO)
|
RecoveryUtils |
Provides a set of static functions for recovery related tooling.
|
TierMetadataComparator |
This tool will act as the downstream of the fencing tool in the recovery workflow
Once the fenced tier topic details are available as input, this tool will do the following:
1.
|
TierMetadataDebugger |
TierMetadataDebugger is a tool to dump raw metadata events of TierTopicPartitions, additionally it can also materialize and
generate expected state.
|
TierMetadataValidator |
TierMetadataValidator: Tool to validate the materialization of the tier topic partition's materialization states.
|
TierMetadataValidator.OffsetValidationResult | |
TierObjectStoreFactory |
This class will act as the factory for generating and maintaining the instance map for the various kinds
of the object store backends.
|
TierPartitionStateFencingTrigger |
A tool that injects PartitionFence events into TierTopic for a provided list of
TopicIdPartition.
|
TierPartitionStateJsonConvert |
This is a tool that will be useful for manually fixing the metadata in the ftps file when metadata corrupts.
|
TierPartitionStateJsonWrapper |
Class which wraps FileTierPartitionState Header and the list of TierObjectMetadata
It provides functionalities to
1.
|
TierPartitionStateRestoreRawInputGenerator |
This class provides a tool that generates the raw input for tier state restoration using:
(1) the output of the fencing command, and
(2) a root directory containing the tier partition state files to be restored
|
TierPartitionStateRestoreTrigger |
A tool that injects PartitionForceRestore events into TierTopic for a provided list of
TopicIdPartition.
|
TierPartitionUnfreezeLogStartOffsetTrigger | |
TierRecoveryConfig | |
TierTopicMaterializationToolConfig | |
TierTopicMaterializationUtils |
TierTopicMaterializationUtils provides utils for dumping materialization events from tier topic for the given source
topic(or all) for a give source partition(or all).
|
TierTopicPartitionId |
Utility tool that calculates tier state topic partition id for a given topic partition.
|
ValidateAndRestoreSegments |
/opt/confluent/bin/kafka-run-class.sh kafka.tier.tools.ValidateAndRestoreSegments --help
usage: kafka.tier.tools.ValidateAndRestoreSegments
option - {validate, restore}
[-h] --ftps FTPS --topic-name TOPIC-NAME --partition PARTITION [--tier.config TIER.CONFIG] --files-to-restore FILES-TO-RESTORE [--logging.level LOGGING.LEVEL]
Validate and restore inconsistent segment in FTPS from tiered storage
optional arguments:
-h, --help show this help message and exit
--ftps FTPS Path of the tier partition state file
--topic-name TOPIC-NAME
Topic name
--partition PARTITION Partition number
--tier.config TIER.CONFIG
The path to a configuration file containing the required properties
--files-to-restore FILES-TO-RESTORE
Path of the file containing files to restore
--logging.level LOGGING.LEVEL
* Logging level for the tool (default: INFO)
|
ValidateFtpsSegmentsResponse | |
ValidateSegments |
/opt/confluent/bin/kafka-run-class kafka.tier.tools.ValidateSegments --help
usage: kafka.tier.tools.ValidateSegments
[-h] --log.dir LOG.DIR --start.offset [--tier.config TIER.CONFIG] [--logging.level LOGGING.LEVEL]
Provides a facility to check the missing files from tiered store
optional arguments:
-h, --help show this help message and exit
--log.dir LOG.DIR Fully qualified path for log directory where tier state file is located
--tier.config TIER.CONFIG
The path to a configuration file containing the required properties (default: /mnt/config/kafka.properties)
--logging.level LOGGING.LEVEL
Logging level for the tool (default: INFO)
|
Exception | Description |
---|---|
TierPartitionStateRestoreRawInputGenerator.InvalidInputException |