Package org.apache.flink.streaming.api.operators.python.embedded

Class AbstractEmbeddedPythonFunctionOperator<OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.embedded.AbstractEmbeddedPythonFunctionOperator<OUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.YieldingOperator<OUT>

Direct Known Subclasses:

AbstractEmbeddedDataStreamPythonFunctionOperator, AbstractEmbeddedStatelessFunctionOperator

@Internal
public abstract class AbstractEmbeddedPythonFunctionOperator<OUT>
extends AbstractPythonFunctionOperator<OUT>

Abstract class for all stream operators to execute Python functions in embedded Python environment.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
protected pemja.core.PythonInterpreter	interpreter	Every operator will hold the only python interpreter.

Fields inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

combinedWatermark, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

Constructor Summary

Constructors

Constructor	Description
AbstractEmbeddedPythonFunctionOperator(org.apache.flink.configuration.Configuration config)

Method Summary

Modifier and Type	Method	Description
void	close()
protected EmbeddedPythonEnvironmentManager	createPythonEnvironmentManager()
protected void	invokeFinishBundle()
void	open()
abstract void	openPythonInterpreter()	Setup method for Python Interpreter.

Methods inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, drainUnregisteredTimers, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setCurrentKey

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

beforeInitializeStateHandler, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isAsyncKeyOrderedProcessingEnabled, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark1, processWatermark2, processWatermark2, processWatermarkStatus, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useInterruptibleTimers

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

getOperatorAttributes

Field Detail

interpreter

protected transient pemja.core.PythonInterpreter interpreter

Every operator will hold the only python interpreter.

Constructor Detail

AbstractEmbeddedPythonFunctionOperator

public AbstractEmbeddedPythonFunctionOperator(org.apache.flink.configuration.Configuration config)

Method Detail

open

public void open()
          throws Exception

Specified by:

open in interface org.apache.flink.streaming.api.operators.StreamOperator<OUT>

Overrides:

open in class AbstractPythonFunctionOperator<OUT>

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.streaming.api.operators.StreamOperator<OUT>

Overrides:

close in class AbstractPythonFunctionOperator<OUT>

Throws:

Exception

createPythonEnvironmentManager

protected EmbeddedPythonEnvironmentManager createPythonEnvironmentManager()

Specified by:

createPythonEnvironmentManager in class AbstractPythonFunctionOperator<OUT>

invokeFinishBundle

protected void invokeFinishBundle()
                           throws Exception

Specified by:

invokeFinishBundle in class AbstractPythonFunctionOperator<OUT>

Throws:

Exception

openPythonInterpreter

public abstract void openPythonInterpreter()

Setup method for Python Interpreter.