Class FileCopyTaskInputFormat
- java.lang.Object
-
- org.apache.flink.examples.java.distcp.FileCopyTaskInputFormat
-
- All Implemented Interfaces:
Serializable,org.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>,org.apache.flink.core.io.InputSplitSource<FileCopyTaskInputSplit>
public class FileCopyTaskInputFormat extends Object implements org.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>
An implementation of an input format that dynamically assignsFileCopyTaskto the mappers that have finished previously assigned tasks.- See Also:
- Serialized Form
-
-
Constructor Summary
Constructors Constructor Description FileCopyTaskInputFormat(List<FileCopyTask> tasks)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description voidclose()voidconfigure(org.apache.flink.configuration.Configuration parameters)FileCopyTaskInputSplit[]createInputSplits(int minNumSplits)org.apache.flink.core.io.InputSplitAssignergetInputSplitAssigner(FileCopyTaskInputSplit[] inputSplits)org.apache.flink.api.common.io.statistics.BaseStatisticsgetStatistics(org.apache.flink.api.common.io.statistics.BaseStatistics cachedStatistics)FileCopyTasknextRecord(FileCopyTask reuse)voidopen(FileCopyTaskInputSplit split)booleanreachedEnd()
-
-
-
Constructor Detail
-
FileCopyTaskInputFormat
public FileCopyTaskInputFormat(List<FileCopyTask> tasks)
-
-
Method Detail
-
configure
public void configure(org.apache.flink.configuration.Configuration parameters)
- Specified by:
configurein interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>
-
getStatistics
public org.apache.flink.api.common.io.statistics.BaseStatistics getStatistics(org.apache.flink.api.common.io.statistics.BaseStatistics cachedStatistics) throws IOException- Specified by:
getStatisticsin interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>- Throws:
IOException
-
createInputSplits
public FileCopyTaskInputSplit[] createInputSplits(int minNumSplits) throws IOException
- Specified by:
createInputSplitsin interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>- Specified by:
createInputSplitsin interfaceorg.apache.flink.core.io.InputSplitSource<FileCopyTaskInputSplit>- Throws:
IOException
-
getInputSplitAssigner
public org.apache.flink.core.io.InputSplitAssigner getInputSplitAssigner(FileCopyTaskInputSplit[] inputSplits)
- Specified by:
getInputSplitAssignerin interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>- Specified by:
getInputSplitAssignerin interfaceorg.apache.flink.core.io.InputSplitSource<FileCopyTaskInputSplit>
-
open
public void open(FileCopyTaskInputSplit split) throws IOException
- Specified by:
openin interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>- Throws:
IOException
-
reachedEnd
public boolean reachedEnd() throws IOException- Specified by:
reachedEndin interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>- Throws:
IOException
-
nextRecord
public FileCopyTask nextRecord(FileCopyTask reuse) throws IOException
- Specified by:
nextRecordin interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>- Throws:
IOException
-
close
public void close() throws IOException- Specified by:
closein interfaceorg.apache.flink.api.common.io.InputFormat<FileCopyTask,FileCopyTaskInputSplit>- Throws:
IOException
-
-