Package org.apache.flink.streaming.api.utils

Class PythonTypeUtils

java.lang.Object

org.apache.flink.streaming.api.utils.PythonTypeUtils

@Internal
public class PythonTypeUtils
extends Object

A util class for converting the given TypeInformation to other objects.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	PythonTypeUtils.ArrayDataConverter<T>	The element in the Object Array will be converted to the corresponding Data through element DataConverter.
static class	PythonTypeUtils.ByteDataConverter	Python Long will be converted to Long in PemJa, so we need ByteDataConverter to convert Java Long to internal Byte.
static class	PythonTypeUtils.DataConverter<IN,OUT>	Data Converter that converts the data to the format data which can be used in PemJa.
static class	PythonTypeUtils.FloatDataConverter	Python Float will be converted to Double in PemJa, so we need FloatDataConverter to convert Java Double to internal Float.
static class	PythonTypeUtils.IdentityDataConverter<T>	Identity data converter.
static class	PythonTypeUtils.IntDataConverter	Python Long will be converted to Long in PemJa, so we need IntDataConverter to convert Java Long to internal Integer.
static class	PythonTypeUtils.ListDataConverter	The element in the List will be converted to the corresponding Data through element DataConverter.
static class	PythonTypeUtils.MapDataConverter	The key/value in the Map will be converted to the corresponding Data through key/value DataConverter.
static class	PythonTypeUtils.RowDataConverter	Row Data will be converted to the Object Array [RowKind(as Long Object), Field Values(as Object Array)].
static class	PythonTypeUtils.RowDataDataConverter	RowData Data will be converted to the Object Array [RowKind(as Long Object), Field Values(as Object Array)].
static class	PythonTypeUtils.ShortDataConverter	Python Long will be converted to Long in PemJa, so we need ShortDataConverter to convert Java Long to internal Short.
static class	PythonTypeUtils.TupleDataConverter	Tuple Data will be converted to the Object Array.
static class	PythonTypeUtils.TypeInfoToDataConverter	Get DataConverter according to the given typeInformation.
static class	PythonTypeUtils.TypeInfoToProtoConverter	Get coder proto according to the given type information.
static class	PythonTypeUtils.TypeInfoToSerializerConverter	Get serializers according to the given typeInformation.

Constructor Summary

Constructors

Constructor	Description
PythonTypeUtils()

Method Summary

Modifier and Type	Method	Description
static <T> org.apache.flink.api.common.io.InputFormat<T,?>	getCollectionInputFormat(List<T> data, org.apache.flink.api.common.typeinfo.TypeInformation<T> dataType, org.apache.flink.api.common.ExecutionConfig config)	Wrap the unpickled python data with an InputFormat.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PythonTypeUtils

public PythonTypeUtils()

Method Detail

getCollectionInputFormat

public static <T> org.apache.flink.api.common.io.InputFormat<T,?> getCollectionInputFormat(List<T> data,
                                                                                                 org.apache.flink.api.common.typeinfo.TypeInformation<T> dataType,
                                                                                                 org.apache.flink.api.common.ExecutionConfig config)

Wrap the unpickled python data with an InputFormat. It will be passed to StreamExecutionEnvironment.creatInput() to create an InputFormat later.

Parameters:

data - The unpickled python data.

dataType - The python data type.

config - The execution config used to create serializer.

Returns:

An InputFormat containing the python data.