Package org.apache.flink.streaming.api.connector.sink2

Interface WithPreCommitTopology<InputT,CommT>

All Superinterfaces:

Serializable, org.apache.flink.api.connector.sink2.Sink<InputT>, org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<InputT,CommT>

@Experimental
public interface WithPreCommitTopology<InputT,CommT>
extends org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<InputT,CommT>

Allows expert users to implement a custom topology after SinkWriter and before Committer.

It is recommended to use immutable committables because mutating committables can have unexpected side-effects.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.Sink

org.apache.flink.api.connector.sink2.Sink.InitContext

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink

org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink.PrecommittingSinkWriter<InputT extends Object,CommT extends Object>

Method Summary

Modifier and Type	Method	Description
DataStream<CommittableMessage<CommT>>	addPreCommitTopology(DataStream<CommittableMessage<CommT>> committables)	Intercepts and modifies the committables sent on checkpoint or at end of input.

Methods inherited from interface org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink

createCommitter, createWriter, getCommittableSerializer

Method Detail

addPreCommitTopology

DataStream<CommittableMessage<CommT>> addPreCommitTopology(DataStream<CommittableMessage<CommT>> committables)

Intercepts and modifies the committables sent on checkpoint or at end of input. Implementers need to ensure to modify all CommittableMessages appropriately.

Parameters:

committables - the stream of committables.

Returns:

the custom topology before Committer.