Package org.apache.flink.table.runtime.operators.deduplicate.window.processors

Class RowTimeSyncStateWindowDeduplicateProcessor

java.lang.Object

org.apache.flink.table.runtime.operators.deduplicate.window.processors.RowTimeSyncStateWindowDeduplicateProcessor

All Implemented Interfaces:

Serializable, SyncStateWindowProcessor<Long>, WindowProcessor<Long,SyncStateWindowProcessor.SyncStateContext<Long>>, SlicingSyncStateWindowProcessor<Long>

public final class RowTimeSyncStateWindowDeduplicateProcessor
extends Object
implements SlicingSyncStateWindowProcessor<Long>

A rowtime window deduplicate processor.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.table.runtime.operators.window.tvf.common.SyncStateWindowProcessor

SyncStateWindowProcessor.SyncStateContext<W>

Nested classes/interfaces inherited from interface org.apache.flink.table.runtime.operators.window.tvf.common.WindowProcessor

WindowProcessor.Context<W>

Constructor Summary

Constructors

Constructor	Description
RowTimeSyncStateWindowDeduplicateProcessor(org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData> inputSerializer, WindowBuffer.Factory bufferFactory, int windowEndIndex, ZoneId shiftTimeZone)

Method Summary

Modifier and Type	Method	Description
void	advanceProgress(long progress)	Advances the progress time, the progress time is watermark if working in event-time mode, or current processing time if working in processing-time mode.
void	clearWindow(long timerTimestamp, Long windowEnd)	Clear state and resources associated with the given window namespace.
void	close()	The tear-down method of the function.
org.apache.flink.api.common.typeutils.TypeSerializer<Long>	createWindowSerializer()	Returns the serializer of the window type.
void	fireWindow(long timerTimestamp, Long windowEnd)	Emit results of the given window.
void	initializeWatermark(long watermark)	Initializes the watermark which restores from state.
void	open(SyncStateWindowProcessor.SyncStateContext<Long> context)	Initialization method for the function.
void	prepareCheckpoint()	Performs a preparation before checkpoint.
boolean	processElement(org.apache.flink.table.data.RowData key, org.apache.flink.table.data.RowData element)	Process an element with associated key from the input stream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RowTimeSyncStateWindowDeduplicateProcessor

public RowTimeSyncStateWindowDeduplicateProcessor(org.apache.flink.api.common.typeutils.TypeSerializer<org.apache.flink.table.data.RowData> inputSerializer,
                                                  WindowBuffer.Factory bufferFactory,
                                                  int windowEndIndex,
                                                  ZoneId shiftTimeZone)

Method Detail

open

public void open(SyncStateWindowProcessor.SyncStateContext<Long> context)
          throws Exception

Description copied from interface: WindowProcessor

Initialization method for the function. It is called before the actual working methods.

Specified by:

open in interface WindowProcessor<Long,SyncStateWindowProcessor.SyncStateContext<Long>>

Throws:

Exception

initializeWatermark

public void initializeWatermark(long watermark)

Description copied from interface: WindowProcessor

Initializes the watermark which restores from state. The method is called after open method and before the actual working methods.

Specified by:

initializeWatermark in interface WindowProcessor<Long,SyncStateWindowProcessor.SyncStateContext<Long>>

Parameters:

watermark - the initial watermark

processElement

public boolean processElement(org.apache.flink.table.data.RowData key,
                              org.apache.flink.table.data.RowData element)
                       throws Exception

Description copied from interface: SyncStateWindowProcessor

Process an element with associated key from the input stream. Returns true if this element is dropped because of late arrival.

Specified by:

processElement in interface SyncStateWindowProcessor<Long>

Parameters:

key - the key associated with the element

element - The element to process.

Throws:

Exception

advanceProgress

public void advanceProgress(long progress)
                     throws Exception

Description copied from interface: SyncStateWindowProcessor

Advances the progress time, the progress time is watermark if working in event-time mode, or current processing time if working in processing-time mode.

This will potentially flush buffered data into states, because the watermark advancement may be in a very small step, but we don't need to flush buffered data for every watermark advancement.

Specified by:

advanceProgress in interface SyncStateWindowProcessor<Long>

Parameters:

progress - the current progress time

Throws:

Exception

prepareCheckpoint

public void prepareCheckpoint()
                       throws Exception

Description copied from interface: SyncStateWindowProcessor

Performs a preparation before checkpoint. This usually flushes buffered data into state.

Specified by:

prepareCheckpoint in interface SyncStateWindowProcessor<Long>

Throws:

Exception

clearWindow

public void clearWindow(long timerTimestamp,
                        Long windowEnd)
                 throws Exception

Description copied from interface: SyncStateWindowProcessor

Clear state and resources associated with the given window namespace.

Note: the key context has been set.

Specified by:

clearWindow in interface SyncStateWindowProcessor<Long>

Parameters:

timerTimestamp - the fired timestamp

windowEnd - the window to clear

Throws:

Exception

close

public void close()
           throws Exception

Description copied from interface: WindowProcessor

The tear-down method of the function. It is called after the last call to the main working methods.

Specified by:

close in interface WindowProcessor<Long,SyncStateWindowProcessor.SyncStateContext<Long>>

Throws:

Exception

createWindowSerializer

public org.apache.flink.api.common.typeutils.TypeSerializer<Long> createWindowSerializer()

Description copied from interface: WindowProcessor

Returns the serializer of the window type.

Specified by:

createWindowSerializer in interface WindowProcessor<Long,SyncStateWindowProcessor.SyncStateContext<Long>>

fireWindow

public void fireWindow(long timerTimestamp,
                       Long windowEnd)
                throws Exception

Description copied from interface: SyncStateWindowProcessor

Emit results of the given window.

Note: the key context has been set.

Specified by:

fireWindow in interface SyncStateWindowProcessor<Long>

Parameters:

timerTimestamp - the fired timestamp

windowEnd - the window to emit

Throws:

Exception