Package org.apache.flink.table.runtime.operators.python.aggregate

Class PythonStreamGroupAggregateOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator<OUT>

org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamAggregateOperator

org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamGroupAggregateOperator

org.apache.flink.table.runtime.operators.python.aggregate.PythonStreamGroupAggregateOperator

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.Triggerable<org.apache.flink.table.data.RowData,org.apache.flink.runtime.state.VoidNamespace>, org.apache.flink.table.runtime.functions.CleanupState

@Internal
public class PythonStreamGroupAggregateOperator
extends AbstractPythonStreamGroupAggregateOperator

The Python AggregateFunction operator.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
protected static String	STREAM_GROUP_AGGREGATE_URN

Fields inherited from class org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamAggregateOperator

bais, baisWrapper, baos, baosWrapper, inputType, outputType, rowDataWrapper, userDefinedFunctionInputType, userDefinedFunctionOutputType

Fields inherited from class org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

pythonFunctionRunner

Fields inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService

Constructor Summary

Constructors

Constructor

Description

PythonStreamGroupAggregateOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType outputType, org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions, org.apache.flink.table.runtime.dataview.DataViewSpec[][] dataViewSpecs, int[] grouping, int indexOfCountStar, boolean countStarInserted, boolean generateUpdateBefore, long minRetentionTime, long maxRetentionTime)

Method Summary

Modifier and Type	Method	Description
String	getFunctionUrn()
FlinkFnApi.UserDefinedAggregateFunctions	getUserDefinedFunctionsProto()	Gets the proto representation of the Python user-defined aggregate functions to be executed.

Methods inherited from class org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamGroupAggregateOperator

createUserDefinedFunctionInputType, createUserDefinedFunctionOutputType, emitResult, onEventTime, onProcessingTime, open, processElementInternal

Methods inherited from class org.apache.flink.table.runtime.operators.python.aggregate.AbstractPythonStreamAggregateOperator

createInputCoderInfoDescriptor, createOutputCoderInfoDescriptor, createPythonFunctionRunner, getCurrentKey, getKeyType, getPythonEnv, processElement, setCurrentKey

Methods inherited from class org.apache.flink.table.runtime.operators.python.AbstractOneInputPythonFunctionOperator

endInput

Methods inherited from class org.apache.flink.streaming.api.operators.python.process.AbstractExternalPythonFunctionOperator

close, createPythonEnvironmentManager, drainUnregisteredTimers, emitResults, invokeFinishBundle

Methods inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, prepareSnapshotPreBarrier, processWatermark

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.table.runtime.functions.CleanupState

registerProcessingCleanupTimer

Methods inherited from interface org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processRecordAttributes, processWatermark, processWatermarkStatus

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Field Detail

STREAM_GROUP_AGGREGATE_URN

@VisibleForTesting
protected static final String STREAM_GROUP_AGGREGATE_URN

See Also:

Constant Field Values

Constructor Detail

PythonStreamGroupAggregateOperator

public PythonStreamGroupAggregateOperator(org.apache.flink.configuration.Configuration config,
                                          org.apache.flink.table.types.logical.RowType inputType,
                                          org.apache.flink.table.types.logical.RowType outputType,
                                          org.apache.flink.table.functions.python.PythonAggregateFunctionInfo[] aggregateFunctions,
                                          org.apache.flink.table.runtime.dataview.DataViewSpec[][] dataViewSpecs,
                                          int[] grouping,
                                          int indexOfCountStar,
                                          boolean countStarInserted,
                                          boolean generateUpdateBefore,
                                          long minRetentionTime,
                                          long maxRetentionTime)

Method Detail

getUserDefinedFunctionsProto

public FlinkFnApi.UserDefinedAggregateFunctions getUserDefinedFunctionsProto()

Gets the proto representation of the Python user-defined aggregate functions to be executed.

Overrides:

getUserDefinedFunctionsProto in class AbstractPythonStreamGroupAggregateOperator

getFunctionUrn

public String getFunctionUrn()

Specified by:

getFunctionUrn in class AbstractPythonStreamAggregateOperator