Uses of Class
org.apache.flink.runtime.io.network.buffer.BufferCompressor
-
-
Uses of BufferCompressor in org.apache.flink.runtime.io.network.partition
Fields in org.apache.flink.runtime.io.network.partition declared as BufferCompressor Modifier and Type Field Description protected BufferCompressorResultPartition. bufferCompressorUsed to compress buffer to reduce IO.Constructors in org.apache.flink.runtime.io.network.partition with parameters of type BufferCompressor Constructor Description BoundedBlockingResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, ResultSubpartition[] subpartitions, int numTargetKeyGroups, ResultPartitionManager partitionManager, BufferCompressor bufferCompressor, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory)BufferWritingResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, ResultSubpartition[] subpartitions, int numTargetKeyGroups, ResultPartitionManager partitionManager, BufferCompressor bufferCompressor, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory)PipelinedResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, ResultSubpartition[] subpartitions, int numTargetKeyGroups, ResultPartitionManager partitionManager, BufferCompressor bufferCompressor, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory)ResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, int numSubpartitions, int numTargetKeyGroups, ResultPartitionManager partitionManager, BufferCompressor bufferCompressor, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory)SortMergeResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, int numSubpartitions, int numTargetKeyGroups, BatchShuffleReadBufferPool readBufferPool, Executor readIOExecutor, ResultPartitionManager partitionManager, String resultFileBasePath, BufferCompressor bufferCompressor, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory) -
Uses of BufferCompressor in org.apache.flink.runtime.io.network.partition.hybrid
Constructors in org.apache.flink.runtime.io.network.partition.hybrid with parameters of type BufferCompressor Constructor Description HsMemoryDataManager(int numSubpartitions, int bufferSize, BufferPool bufferPool, HsSpillingStrategy spillStrategy, HsFileDataIndex fileDataIndex, Path dataFilePath, BufferCompressor bufferCompressor, long poolSizeCheckInterval)HsResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, int numSubpartitions, int numTargetKeyGroups, BatchShuffleReadBufferPool readBufferPool, ScheduledExecutorService readIOExecutor, ResultPartitionManager partitionManager, String dataFileBashPath, int networkBufferSize, HybridShuffleConfiguration hybridShuffleConfiguration, BufferCompressor bufferCompressor, boolean isBroadcastOnly, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory) -
Uses of BufferCompressor in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return BufferCompressor Modifier and Type Method Description static BufferCompressorTieredStorageUtils. buildBufferCompressor(int bufferSizeBytes, org.apache.flink.configuration.Configuration configuration)Construct theBufferCompressorfrom configuration.Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type BufferCompressor Modifier and Type Method Description static booleanTieredStorageUtils. canBeCompressed(Buffer buffer, BufferCompressor bufferCompressor)Whether the buffer can be compressed or not.static BufferTieredStorageUtils. compressBufferIfPossible(Buffer buffer, BufferCompressor bufferCompressor)Try compress buffer if possible. -
Uses of BufferCompressor in org.apache.flink.runtime.io.network.partition.hybrid.tiered.shuffle
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.shuffle with parameters of type BufferCompressor Modifier and Type Method Description TieredResultPartitionTieredResultPartitionFactory. createTieredResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, int numPartitions, int numSubpartitions, int maxParallelism, int bufferSizeBytes, Boolean isBroadCastOnly, ResultPartitionManager partitionManager, BufferCompressor bufferCompressor, List<TierShuffleDescriptor> tierShuffleDescriptors, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory, FileChannelManager fileChannelManager, BatchShuffleReadBufferPool batchShuffleReadBufferPool, ScheduledExecutorService batchShuffleReadIOExecutor, boolean isNumberOfPartitionConsumerUndefined)Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.shuffle with parameters of type BufferCompressor Constructor Description TieredResultPartition(String owningTaskName, int partitionIndex, ResultPartitionID partitionId, ResultPartitionType partitionType, int numSubpartitions, int numTargetKeyGroups, ResultPartitionManager partitionManager, BufferCompressor bufferCompressor, org.apache.flink.util.function.SupplierWithException<BufferPool,IOException> bufferPoolFactory, TieredStorageProducerClient tieredStorageProducerClient, TieredStorageResourceRegistry tieredStorageResourceRegistry, TieredStorageNettyServiceImpl nettyService, List<TieredStorageMemorySpec> tieredStorageMemorySpecs, TieredStorageMemoryManager storageMemoryManager) -
Uses of BufferCompressor in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type BufferCompressor Constructor Description TieredStorageProducerClient(int numSubpartitions, boolean isBroadcastOnly, BufferAccumulator bufferAccumulator, BufferCompressor bufferCompressor, List<TierProducerAgent> tierProducerAgents) -
Uses of BufferCompressor in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type BufferCompressor Constructor Description MemoryTierProducerAgent(TieredStoragePartitionId partitionId, int numSubpartitions, int bufferSizeBytes, int segmentSizeBytes, int subpartitionMaxQueuedBuffers, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BufferCompressor bufferCompressor)
-