Package org.apache.flink.table.runtime.operators.python

Class AbstractEmbeddedStatelessFunctionOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.embedded.AbstractEmbeddedPythonFunctionOperator<org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.python.AbstractEmbeddedStatelessFunctionOperator

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

Direct Known Subclasses:

EmbeddedPythonScalarFunctionOperator, EmbeddedPythonTableFunctionOperator

@Internal
public abstract class AbstractEmbeddedStatelessFunctionOperator
extends AbstractEmbeddedPythonFunctionOperator<org.apache.flink.table.data.RowData>
implements org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.BoundedOneInput

Base class for all stream operators to execute Python Stateless Functions in embedded Python environment.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
protected org.apache.flink.table.types.logical.RowType	inputType	The input logical type.
protected org.apache.flink.table.data.GenericRowData	reuseResultRowData	The GenericRowData reused holding the execution result of python udf.
protected StreamRecordRowDataWrappingCollector	rowDataWrapper	The collector used to collect records.
protected int[]	udfInputOffsets	The offsets of user-defined function inputs.
protected org.apache.flink.table.types.logical.RowType	udfInputType	The user-defined function input logical type.
protected org.apache.flink.table.types.logical.RowType	udfOutputType	The user-defined function output logical type.
protected Object[]	userDefinedFunctionInputArgs
protected PythonTypeUtils.DataConverter[]	userDefinedFunctionInputConverters
protected PythonTypeUtils.DataConverter[]	userDefinedFunctionOutputConverters

Fields inherited from class org.apache.flink.streaming.api.operators.python.embedded.AbstractEmbeddedPythonFunctionOperator

interpreter

Fields inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService

Constructor Summary

Constructors

Constructor	Description
AbstractEmbeddedStatelessFunctionOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType udfInputType, org.apache.flink.table.types.logical.RowType udfOutputType, int[] udfInputOffsets)

Method Summary

Modifier and Type	Method	Description
void	open()

Methods inherited from class org.apache.flink.streaming.api.operators.python.embedded.AbstractEmbeddedPythonFunctionOperator

close, createPythonEnvironmentManager, invokeFinishBundle, openPythonInterpreter

Methods inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setCurrentKey

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.BoundedOneInput

endInput

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.Input

processElement, processLatencyMarker, processWatermark, processWatermarkStatus

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Field Detail

udfInputOffsets

protected final int[] udfInputOffsets

The offsets of user-defined function inputs.

inputType

protected final org.apache.flink.table.types.logical.RowType inputType

The input logical type.

udfInputType

protected final org.apache.flink.table.types.logical.RowType udfInputType

The user-defined function input logical type.

udfOutputType

protected final org.apache.flink.table.types.logical.RowType udfOutputType

The user-defined function output logical type.

reuseResultRowData

protected transient org.apache.flink.table.data.GenericRowData reuseResultRowData

The GenericRowData reused holding the execution result of python udf.

rowDataWrapper

protected transient StreamRecordRowDataWrappingCollector rowDataWrapper

The collector used to collect records.

userDefinedFunctionInputConverters

protected transient PythonTypeUtils.DataConverter[] userDefinedFunctionInputConverters

userDefinedFunctionInputArgs

protected transient Object[] userDefinedFunctionInputArgs

userDefinedFunctionOutputConverters

protected transient PythonTypeUtils.DataConverter[] userDefinedFunctionOutputConverters

Constructor Detail

AbstractEmbeddedStatelessFunctionOperator

public AbstractEmbeddedStatelessFunctionOperator(org.apache.flink.configuration.Configuration config,
                                                 org.apache.flink.table.types.logical.RowType inputType,
                                                 org.apache.flink.table.types.logical.RowType udfInputType,
                                                 org.apache.flink.table.types.logical.RowType udfOutputType,
                                                 int[] udfInputOffsets)

Method Detail

open

public void open()
          throws Exception

Specified by:

open in interface org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

Overrides:

open in class AbstractEmbeddedPythonFunctionOperator<org.apache.flink.table.data.RowData>

Throws:

Exception