C D G H O P R S W
All Classes All Packages
All Classes All Packages
All Classes All Packages
C
- cleanupInProgressFileRecoverable(InProgressFileWriter.InProgressFileRecoverable) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter
- closeForCommit() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter
- commit() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter
- commit() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter
-
Commits the in-progress file to the target path.
- commitAfterRecovery() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter
- commitAfterRecovery() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter
-
Re-commits the in-progress file to the target path after fail-over.
- create(Configuration, Path) - Method in class org.apache.flink.formats.hadoop.bulk.DefaultHadoopFileCommitterFactory
- create(Configuration, Path) - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitterFactory
-
Creates a new Hadoop file committer for writing.
- create(Path, Path) - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopPathBasedBulkWriter.Factory
-
Creates a path-based writer that writes to the inProgressPath first and commits to targetPath finally.
- createBuckets(int) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- createBucketWriter() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
D
- DefaultHadoopFileCommitterFactory - Class in org.apache.flink.formats.hadoop.bulk
-
The default hadoop file committer factory which always use
HadoopRenameFileCommitter. - DefaultHadoopFileCommitterFactory() - Constructor for class org.apache.flink.formats.hadoop.bulk.DefaultHadoopFileCommitterFactory
- dispose() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopPathBasedBulkWriter
-
Disposes the writer on failures.
- dispose() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter
G
- getConfiguration() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.SerializableConfiguration
- getProperties() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter
- getSize() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopPathBasedBulkWriter
-
Gets the size written by the current writer.
- getSize() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter
- getTargetFilePath() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter
- getTargetFilePath() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter
-
Gets the target path to commit to.
- getTempFilePath() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter
- getTempFilePath() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter
-
Gets the path of the intermediate file to commit.
H
- HadoopFileCommitter - Interface in org.apache.flink.formats.hadoop.bulk
-
The committer publishes an intermediate Hadoop file to the target path after it finishes writing.
- HadoopFileCommitterFactory - Interface in org.apache.flink.formats.hadoop.bulk
-
The factory to create the
HadoopFileCommitter. - HadoopPathBasedBucketWriter(Configuration, HadoopPathBasedBulkWriter.Factory<IN>, HadoopFileCommitterFactory) - Constructor for class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter
- HadoopPathBasedBulkFormatBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>> - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
Buckets builder to create buckets that use
HadoopPathBasedPartFileWriter. - HadoopPathBasedBulkFormatBuilder(Path, HadoopPathBasedBulkWriter.Factory<IN>, HadoopFileCommitterFactory, Configuration, BucketAssigner<IN, BucketID>, CheckpointRollingPolicy<IN, BucketID>, BucketFactory<IN, BucketID>, OutputFileConfig) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- HadoopPathBasedBulkFormatBuilder(Path, HadoopPathBasedBulkWriter.Factory<IN>, Configuration, BucketAssigner<IN, BucketID>) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- HadoopPathBasedBulkWriter<T> - Interface in org.apache.flink.formats.hadoop.bulk
-
Specialized
BulkWriterwhich is expected to write to specifiedPath. - HadoopPathBasedBulkWriter.Factory<T> - Interface in org.apache.flink.formats.hadoop.bulk
-
A factory that creates a
HadoopPathBasedBulkWriter. - HadoopPathBasedPartFileWriter<IN,BucketID> - Class in org.apache.flink.formats.hadoop.bulk
-
The part-file writer that writes to the specified hadoop path.
- HadoopPathBasedPartFileWriter(BucketID, HadoopPathBasedBulkWriter<IN>, HadoopFileCommitter, long) - Constructor for class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter
- HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter<IN,BucketID> - Class in org.apache.flink.formats.hadoop.bulk
-
Factory to create
HadoopPathBasedPartFileWriter. - HadoopRenameFileCommitter - Class in org.apache.flink.formats.hadoop.bulk.committer
-
The Hadoop file committer that directly rename the in-progress file to the target file.
- HadoopRenameFileCommitter(Configuration, Path) - Constructor for class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter
- HadoopRenameFileCommitter(Configuration, Path, Path) - Constructor for class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter
O
- openNewInProgressFile(BucketID, Path, long) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter
- org.apache.flink.formats.hadoop.bulk - package org.apache.flink.formats.hadoop.bulk
- org.apache.flink.formats.hadoop.bulk.committer - package org.apache.flink.formats.hadoop.bulk.committer
- org.apache.flink.streaming.api.functions.sink.filesystem - package org.apache.flink.streaming.api.functions.sink.filesystem
P
- persist() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter
- preCommit() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter
- preCommit() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter
-
Prepares the intermediates file for committing.
R
- recoverForCommit(Configuration, Path, Path) - Method in class org.apache.flink.formats.hadoop.bulk.DefaultHadoopFileCommitterFactory
- recoverForCommit(Configuration, Path, Path) - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitterFactory
-
Creates a Hadoop file committer for commit the pending file.
- recoverPendingFile(InProgressFileWriter.PendingFileRecoverable) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter
- resumeInProgressFileFrom(BucketID, InProgressFileWriter.InProgressFileRecoverable, long) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter
S
- SerializableConfiguration - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
Wrapper of hadoop Configuration to make it serializable.
- SerializableConfiguration(Configuration) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.SerializableConfiguration
W
- withBucketAssigner(BucketAssigner<IN, BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- withBucketFactory(BucketFactory<IN, BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- withConfiguration(Configuration) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- withOutputFileConfig(OutputFileConfig) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- withRollingPolicy(CheckpointRollingPolicy<IN, BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder
- write(IN, long) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter
All Classes All Packages