Package org.apache.flink.formats.hadoop.bulk

Class HadoopPathBasedPartFileWriter<IN,BucketID>

java.lang.Object

org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter<IN,BucketID>

org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter<IN,BucketID>

All Implemented Interfaces:

org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter, org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter<IN,BucketID>, org.apache.flink.streaming.api.functions.sink.filesystem.PartFileInfo<BucketID>, org.apache.flink.streaming.api.functions.sink.filesystem.RecordWiseCompactingFileWriter<IN>

public class HadoopPathBasedPartFileWriter<IN,BucketID>
extends org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter<IN,BucketID>

The part-file writer that writes to the specified hadoop path.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter<IN,BucketID>	Factory to create HadoopPathBasedPartFileWriter.

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter

org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter.Type

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.InProgressFileRecoverable, org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.PendingFileRecoverable

Constructor Summary

Constructors

Constructor	Description
HadoopPathBasedPartFileWriter(BucketID bucketID, HadoopPathBasedBulkWriter<IN> writer, HadoopFileCommitter fileCommitter, long createTime)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.PendingFileRecoverable	closeForCommit()
void	dispose()
long	getSize()
org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.InProgressFileRecoverable	persist()
void	write(IN element, long currentTime)

Methods inherited from class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter

getBucketId, getCreationTime, getLastUpdateTime, markWrite

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

write

Constructor Detail

HadoopPathBasedPartFileWriter

public HadoopPathBasedPartFileWriter(BucketID bucketID,
                                     HadoopPathBasedBulkWriter<IN> writer,
                                     HadoopFileCommitter fileCommitter,
                                     long createTime)

Method Detail

write

public void write(IN element,
                  long currentTime)
           throws IOException

Throws:

IOException

persist

public org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.InProgressFileRecoverable persist()

closeForCommit

public org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.PendingFileRecoverable closeForCommit()
                                                                                                                    throws IOException

Throws:

IOException

dispose

public void dispose()

getSize

public long getSize()
             throws IOException

Throws:

IOException