Uses of Class
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common.TieredStoragePartitionId
-
-
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return TieredStoragePartitionId Modifier and Type Method Description static TieredStoragePartitionIdTieredStorageIdMappingUtils. convertId(ResultPartitionID resultPartitionId)Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type TieredStoragePartitionId Modifier and Type Method Description static ResultPartitionIDTieredStorageIdMappingUtils. convertId(TieredStoragePartitionId partitionId) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file with parameters of type TieredStoragePartitionId Modifier and Type Method Description static StringSegmentPartitionFile. getPartitionPath(TieredStoragePartitionId partitionId, String basePath)longPartitionFileReader. getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)Get the priority for reading a particular buffer from the partitioned file.longProducerMergedPartitionFileReader. getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)longSegmentPartitionFileReader. getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress)static org.apache.flink.core.fs.PathSegmentPartitionFile. getSegmentFinishDirPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)static org.apache.flink.core.fs.PathSegmentPartitionFile. getSegmentPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, long segmentId)static StringSegmentPartitionFile. getSubpartitionPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId)PartitionFileReader.ReadBufferResultPartitionFileReader. readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)Read a buffer from the partition file.PartitionFileReader.ReadBufferResultProducerMergedPartitionFileReader. readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)PartitionFileReader.ReadBufferResultSegmentPartitionFileReader. readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer)CompletableFuture<Void>PartitionFileWriter. write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)Write the buffers to the partition file.CompletableFuture<Void>ProducerMergedPartitionFileWriter. write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)CompletableFuture<Void>SegmentPartitionFileWriter. write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite)static voidSegmentPartitionFile. writeSegmentFinishFile(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, int segmentId) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty
-
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage that return TieredStoragePartitionId Modifier and Type Method Description TieredStoragePartitionIdTieredStorageConsumerSpec. getPartitionId()Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId Modifier and Type Method Description voidTieredStorageMasterClient. addPartition(TieredStoragePartitionId partitionId)Optional<Buffer>TieredStorageConsumerClient. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)voidAvailabilityNotifier. notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)Notify that the data from the specific partition and subpartition is available in tiered storage.voidTieredStorageMasterClient. releasePartition(TieredStoragePartitionId partitionId)Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionId Constructor Description TieredStorageConsumerSpec(TieredStoragePartitionId tieredStoragePartitionId, TieredStorageSubpartitionId tieredStorageSubpartitionId) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with parameters of type TieredStoragePartitionId Modifier and Type Method Description voidNoOpMasterAgent. addPartition(TieredStoragePartitionId partitionId)voidTierMasterAgent. addPartition(TieredStoragePartitionId partitionId)Add a new tiered storage partition.TierProducerAgentTierFactory. createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout, int maxBufferReadAhead)Creates the producer-side agent of a Tier.Optional<Buffer>TierConsumerAgent. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)Get buffer from the consumer agent.voidNoOpMasterAgent. releasePartition(TieredStoragePartitionId partitionId)voidTierMasterAgent. releasePartition(TieredStoragePartitionId partitionId)Release a tiered storage partition. -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionId Modifier and Type Method Description TierProducerAgentDiskTierFactory. createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionId, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout, int maxBufferReadAhead)Optional<Buffer>DiskTierConsumerAgent. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionId Constructor Description DiskIOScheduler(TieredStoragePartitionId partitionId, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout, int maxBufferReadAhead, java.util.function.BiFunction<Integer,Integer,Integer> firstBufferIndexInSegmentRetriever, PartitionFileReader partitionFileReader) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionId Modifier and Type Method Description TierProducerAgentMemoryTierFactory. createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout, int maxBufferReadAhead)Optional<Buffer>MemoryTierConsumerAgent. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionId Constructor Description MemoryTierProducerAgent(TieredStoragePartitionId partitionId, int numSubpartitions, int bufferSizeBytes, int segmentSizeBytes, int subpartitionMaxQueuedBuffers, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionId Modifier and Type Method Description voidRemoteTierMasterAgent. addPartition(TieredStoragePartitionId partitionID)TierProducerAgentRemoteTierFactory. createProducerAgent(int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, java.time.Duration bufferRequestTimeout, int maxBufferReadAhead)Optional<Buffer>RemoteTierConsumerAgent. getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)voidRemoteTierMasterAgent. releasePartition(TieredStoragePartitionId partitionID)voidRemoteStorageScanner. watchSegment(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)Watch the segment for a specific subpartition in theRemoteStorageScanner.
-