Package org.apache.flink.state.forst.snapshot

Class ForStIncrementalSnapshotStrategy<K>

java.lang.Object

org.apache.flink.state.forst.snapshot.ForStSnapshotStrategyBase<K,ForStSnapshotStrategyBase.ForStNativeSnapshotResources>

org.apache.flink.state.forst.snapshot.ForStNativeFullSnapshotStrategy<K>

org.apache.flink.state.forst.snapshot.ForStIncrementalSnapshotStrategy<K>

Type Parameters:

K - type of the backend keys.

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.runtime.state.SnapshotStrategy<org.apache.flink.runtime.state.KeyedStateHandle,ForStSnapshotStrategyBase.ForStNativeSnapshotResources>

public class ForStIncrementalSnapshotStrategy<K>
extends ForStNativeFullSnapshotStrategy<K>

Snapshot strategy for ForStKeyedStateBackend that is based on disableFileDeletions()+getLiveFiles() of ForSt and creates incremental snapshots.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.state.forst.snapshot.ForStSnapshotStrategyBase

ForStSnapshotStrategyBase.ForStNativeSnapshotResources, ForStSnapshotStrategyBase.ForStSnapshotOperation, ForStSnapshotStrategyBase.PreviousSnapshot

Nested classes/interfaces inherited from interface org.apache.flink.runtime.state.SnapshotStrategy

org.apache.flink.runtime.state.SnapshotStrategy.SnapshotResultSupplier<S extends org.apache.flink.runtime.state.StateObject>

Field Summary

Fields inherited from class org.apache.flink.state.forst.snapshot.ForStNativeFullSnapshotStrategy

stateTransfer

Fields inherited from class org.apache.flink.state.forst.snapshot.ForStSnapshotStrategyBase

backendUID, db, EMPTY_PREVIOUS_SNAPSHOT, keyGroupPrefixBytes, keyGroupRange, keySerializer, kvStateInformation, resourceContainer, resourceGuard

Constructor Summary

Constructors

Constructor

Description

ForStIncrementalSnapshotStrategy(org.forstdb.RocksDB db, org.apache.flink.util.ResourceGuard forstResourceGuard, ForStResourceContainer resourceContainer, org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer, LinkedHashMap<String,ForStOperationUtils.ForStKvStateInfo> kvStateInformation, org.apache.flink.runtime.state.KeyGroupRange keyGroupRange, int keyGroupPrefixBytes, UUID backendUID, SortedMap<Long,Collection<org.apache.flink.runtime.state.IncrementalKeyedStateHandle.HandleAndLocalPath>> uploadedStateHandles, ForStStateDataTransfer stateTransfer, long lastCompletedCheckpointId)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.runtime.state.SnapshotStrategy.SnapshotResultSupplier<org.apache.flink.runtime.state.KeyedStateHandle>	asyncSnapshot(ForStSnapshotStrategyBase.ForStNativeSnapshotResources snapshotResources, long checkpointId, long timestamp, org.apache.flink.runtime.state.CheckpointStreamFactory checkpointStreamFactory, org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions)
void	close()
void	notifyCheckpointAborted(long abortedCheckpointId)
void	notifyCheckpointComplete(long completedCheckpointId)
protected ForStSnapshotStrategyBase.PreviousSnapshot	snapshotMetaData(long checkpointId, List<org.apache.flink.runtime.state.metainfo.StateMetaInfoSnapshot> stateMetaInfoSnapshots)

Methods inherited from class org.apache.flink.state.forst.snapshot.ForStNativeFullSnapshotStrategy

syncPrepareResources

Methods inherited from class org.apache.flink.state.forst.snapshot.ForStSnapshotStrategyBase

getDescription, materializeMetaData

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ForStIncrementalSnapshotStrategy

public ForStIncrementalSnapshotStrategy(@Nonnull
                                        org.forstdb.RocksDB db,
                                        @Nonnull
                                        org.apache.flink.util.ResourceGuard forstResourceGuard,
                                        @Nonnull
                                        ForStResourceContainer resourceContainer,
                                        @Nonnull
                                        org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer,
                                        @Nonnull
                                        LinkedHashMap<String,ForStOperationUtils.ForStKvStateInfo> kvStateInformation,
                                        @Nonnull
                                        org.apache.flink.runtime.state.KeyGroupRange keyGroupRange,
                                        @Nonnegative
                                        int keyGroupPrefixBytes,
                                        @Nonnull
                                        UUID backendUID,
                                        @Nonnull
                                        SortedMap<Long,Collection<org.apache.flink.runtime.state.IncrementalKeyedStateHandle.HandleAndLocalPath>> uploadedStateHandles,
                                        @Nonnull
                                        ForStStateDataTransfer stateTransfer,
                                        long lastCompletedCheckpointId)

Method Detail

asyncSnapshot

public org.apache.flink.runtime.state.SnapshotStrategy.SnapshotResultSupplier<org.apache.flink.runtime.state.KeyedStateHandle> asyncSnapshot(ForStSnapshotStrategyBase.ForStNativeSnapshotResources snapshotResources,
                                                                                                                                             long checkpointId,
                                                                                                                                             long timestamp,
                                                                                                                                             @Nonnull
                                                                                                                                             org.apache.flink.runtime.state.CheckpointStreamFactory checkpointStreamFactory,
                                                                                                                                             @Nonnull
                                                                                                                                             org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions)

Specified by:

asyncSnapshot in interface org.apache.flink.runtime.state.SnapshotStrategy<org.apache.flink.runtime.state.KeyedStateHandle,ForStSnapshotStrategyBase.ForStNativeSnapshotResources>

Overrides:

asyncSnapshot in class ForStNativeFullSnapshotStrategy<K>

notifyCheckpointComplete

public void notifyCheckpointComplete(long completedCheckpointId)

Specified by:

notifyCheckpointComplete in interface org.apache.flink.api.common.state.CheckpointListener

Overrides:

notifyCheckpointComplete in class ForStNativeFullSnapshotStrategy<K>

notifyCheckpointAborted

public void notifyCheckpointAborted(long abortedCheckpointId)

Specified by:

notifyCheckpointAborted in interface org.apache.flink.api.common.state.CheckpointListener

Overrides:

notifyCheckpointAborted in class ForStNativeFullSnapshotStrategy<K>

close

public void close()

Specified by:

close in interface AutoCloseable

Overrides:

close in class ForStNativeFullSnapshotStrategy<K>

snapshotMetaData

protected ForStSnapshotStrategyBase.PreviousSnapshot snapshotMetaData(long checkpointId,
                                                                      @Nonnull
                                                                      List<org.apache.flink.runtime.state.metainfo.StateMetaInfoSnapshot> stateMetaInfoSnapshots)

Overrides:

snapshotMetaData in class ForStNativeFullSnapshotStrategy<K>