Package org.apache.flink.hadoopcompatibility.mapred

Class HadoopReducerWrappedFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.windowing.RichWindowFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>,KEYIN,org.apache.flink.streaming.api.windowing.windows.GlobalWindow>

org.apache.flink.hadoopcompatibility.mapred.HadoopReducerWrappedFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, org.apache.flink.streaming.api.functions.windowing.AllWindowFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>,org.apache.flink.streaming.api.windowing.windows.GlobalWindow>, org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>,KEYIN,org.apache.flink.streaming.api.windowing.windows.GlobalWindow>

@Public
public final class HadoopReducerWrappedFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
extends org.apache.flink.streaming.api.functions.windowing.RichWindowFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>,KEYIN,org.apache.flink.streaming.api.windowing.windows.GlobalWindow>
implements org.apache.flink.streaming.api.functions.windowing.AllWindowFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>,org.apache.flink.streaming.api.windowing.windows.GlobalWindow>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, Serializable

This wrapper maps a Hadoop Reducer (mapred API) to a Flink window function.

This function can be utilized in both keyedStream and non-keyed stream.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor	Description
HadoopReducerWrappedFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer)	Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.
HadoopReducerWrappedFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer, org.apache.hadoop.mapred.JobConf conf)	Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.

Method Summary

Modifier and Type	Method	Description
void	apply(KEYIN text, org.apache.flink.streaming.api.windowing.windows.GlobalWindow globalWindow, Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> iterable, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> collector)
void	apply(org.apache.flink.streaming.api.windowing.windows.GlobalWindow globalWindow, Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> iterable, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> collector)
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>	getProducedType()
void	open(org.apache.flink.api.common.functions.OpenContext openContext)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopReducerWrappedFunction

public HadoopReducerWrappedFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer)

Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.

Parameters:

hadoopReducer - The Hadoop Reducer to wrap.

HadoopReducerWrappedFunction

public HadoopReducerWrappedFunction(org.apache.hadoop.mapred.Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopReducer,
                                    org.apache.hadoop.mapred.JobConf conf)

Maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.

Parameters:

hadoopReducer - The Hadoop Reducer to wrap.

conf - The JobConf that is used to configure the Hadoop Reducer.

Method Detail

open

@PublicEvolving
public void open(org.apache.flink.api.common.functions.OpenContext openContext)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<KEYIN>

apply

public void apply(KEYIN text,
                  org.apache.flink.streaming.api.windowing.windows.GlobalWindow globalWindow,
                  Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> iterable,
                  org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> collector)
           throws Exception

Specified by:

apply in interface org.apache.flink.streaming.api.functions.windowing.WindowFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

Throws:

Exception

apply

public void apply(org.apache.flink.streaming.api.windowing.windows.GlobalWindow globalWindow,
                  Iterable<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>> iterable,
                  org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> collector)
           throws Exception

Specified by:

apply in interface org.apache.flink.streaming.api.functions.windowing.AllWindowFunction<KEYIN,VALUEIN,KEYOUT>

Throws:

Exception