Package org.apache.flink.table.runtime.runners.python.beam

Class BeamTablePythonFunctionRunner

java.lang.Object

org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner

org.apache.flink.table.runtime.runners.python.beam.BeamTablePythonFunctionRunner

All Implemented Interfaces:

AutoCloseable, PythonFunctionRunner

@Internal
public class BeamTablePythonFunctionRunner
extends BeamPythonFunctionRunner

A BeamTablePythonFunctionRunner used to execute Python functions in Table API.

Field Summary

Fields inherited from class org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner

inputCoderDescriptor, LOG, mainInputReceiver, outputCoderDescriptor, resultBuffer, sideOutputCoderDescriptors

Constructor Summary

Constructors

Constructor

Description

BeamTablePythonFunctionRunner(org.apache.flink.runtime.execution.Environment environment, String taskName, ProcessPythonEnvironmentManager environmentManager, String functionUrn, com.google.protobuf.GeneratedMessageV3 userDefinedFunctionProto, FlinkMetricContainer flinkMetricContainer, org.apache.flink.runtime.state.KeyedStateBackend<?> keyedStateBackend, org.apache.flink.api.common.typeutils.TypeSerializer<?> keySerializer, org.apache.flink.api.common.typeutils.TypeSerializer<?> namespaceSerializer, org.apache.flink.runtime.memory.MemoryManager memoryManager, double managedMemoryFraction, FlinkFnApi.CoderInfoDescriptor inputCoderDescriptor, FlinkFnApi.CoderInfoDescriptor outputCoderDescriptor)

Method Summary

Modifier and Type	Method	Description
protected void	buildTransforms(org.apache.beam.model.pipeline.v1.RunnerApi.Components.Builder componentsBuilder)
protected Optional<org.apache.beam.model.pipeline.v1.RunnerApi.Coder>	getOptionalTimerCoderProto()
protected List<org.apache.beam.runners.core.construction.graph.TimerReference>	getTimers(org.apache.beam.model.pipeline.v1.RunnerApi.Components components)
void	processTimer(byte[] timerData)	Send the triggered timer to the Python function.
static BeamTablePythonFunctionRunner	stateful(org.apache.flink.runtime.execution.Environment environment, String taskName, ProcessPythonEnvironmentManager environmentManager, String functionUrn, com.google.protobuf.GeneratedMessageV3 userDefinedFunctionProto, FlinkMetricContainer flinkMetricContainer, org.apache.flink.runtime.state.KeyedStateBackend<?> keyedStateBackend, org.apache.flink.api.common.typeutils.TypeSerializer<?> keySerializer, org.apache.flink.api.common.typeutils.TypeSerializer<?> namespaceSerializer, org.apache.flink.runtime.memory.MemoryManager memoryManager, double managedMemoryFraction, FlinkFnApi.CoderInfoDescriptor inputCoderDescriptor, FlinkFnApi.CoderInfoDescriptor outputCoderDescriptor)
static BeamTablePythonFunctionRunner	stateless(org.apache.flink.runtime.execution.Environment environment, String taskName, ProcessPythonEnvironmentManager environmentManager, String functionUrn, com.google.protobuf.GeneratedMessageV3 userDefinedFunctionProto, FlinkMetricContainer flinkMetricContainer, org.apache.flink.runtime.memory.MemoryManager memoryManager, double managedMemoryFraction, FlinkFnApi.CoderInfoDescriptor inputCoderDescriptor, FlinkFnApi.CoderInfoDescriptor outputCoderDescriptor)

Methods inherited from class org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner

close, createJobBundleFactory, drainUnregisteredTimers, flush, notifyNoMoreResults, open, pollResult, process, startBundle, takeResult

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamTablePythonFunctionRunner

public BeamTablePythonFunctionRunner(org.apache.flink.runtime.execution.Environment environment,
                                     String taskName,
                                     ProcessPythonEnvironmentManager environmentManager,
                                     String functionUrn,
                                     com.google.protobuf.GeneratedMessageV3 userDefinedFunctionProto,
                                     FlinkMetricContainer flinkMetricContainer,
                                     org.apache.flink.runtime.state.KeyedStateBackend<?> keyedStateBackend,
                                     org.apache.flink.api.common.typeutils.TypeSerializer<?> keySerializer,
                                     org.apache.flink.api.common.typeutils.TypeSerializer<?> namespaceSerializer,
                                     org.apache.flink.runtime.memory.MemoryManager memoryManager,
                                     double managedMemoryFraction,
                                     FlinkFnApi.CoderInfoDescriptor inputCoderDescriptor,
                                     FlinkFnApi.CoderInfoDescriptor outputCoderDescriptor)

Method Detail

buildTransforms

protected void buildTransforms(org.apache.beam.model.pipeline.v1.RunnerApi.Components.Builder componentsBuilder)

Specified by:

buildTransforms in class BeamPythonFunctionRunner

getTimers

protected List<org.apache.beam.runners.core.construction.graph.TimerReference> getTimers(org.apache.beam.model.pipeline.v1.RunnerApi.Components components)

Specified by:

getTimers in class BeamPythonFunctionRunner

getOptionalTimerCoderProto

protected Optional<org.apache.beam.model.pipeline.v1.RunnerApi.Coder> getOptionalTimerCoderProto()

Specified by:

getOptionalTimerCoderProto in class BeamPythonFunctionRunner

processTimer

public void processTimer(byte[] timerData)
                  throws Exception

Description copied from interface: PythonFunctionRunner

Send the triggered timer to the Python function.

Specified by:

processTimer in interface PythonFunctionRunner

Overrides:

processTimer in class BeamPythonFunctionRunner

Throws:

Exception

stateless

public static BeamTablePythonFunctionRunner stateless(org.apache.flink.runtime.execution.Environment environment,
                                                      String taskName,
                                                      ProcessPythonEnvironmentManager environmentManager,
                                                      String functionUrn,
                                                      com.google.protobuf.GeneratedMessageV3 userDefinedFunctionProto,
                                                      FlinkMetricContainer flinkMetricContainer,
                                                      org.apache.flink.runtime.memory.MemoryManager memoryManager,
                                                      double managedMemoryFraction,
                                                      FlinkFnApi.CoderInfoDescriptor inputCoderDescriptor,
                                                      FlinkFnApi.CoderInfoDescriptor outputCoderDescriptor)

stateful

public static BeamTablePythonFunctionRunner stateful(org.apache.flink.runtime.execution.Environment environment,
                                                     String taskName,
                                                     ProcessPythonEnvironmentManager environmentManager,
                                                     String functionUrn,
                                                     com.google.protobuf.GeneratedMessageV3 userDefinedFunctionProto,
                                                     FlinkMetricContainer flinkMetricContainer,
                                                     org.apache.flink.runtime.state.KeyedStateBackend<?> keyedStateBackend,
                                                     org.apache.flink.api.common.typeutils.TypeSerializer<?> keySerializer,
                                                     org.apache.flink.api.common.typeutils.TypeSerializer<?> namespaceSerializer,
                                                     org.apache.flink.runtime.memory.MemoryManager memoryManager,
                                                     double managedMemoryFraction,
                                                     FlinkFnApi.CoderInfoDescriptor inputCoderDescriptor,
                                                     FlinkFnApi.CoderInfoDescriptor outputCoderDescriptor)