Uses of Class
org.apache.flink.streaming.api.datastream.DataStream
-
-
Uses of DataStream in org.apache.flink.streaming.api.connector.sink2
Methods in org.apache.flink.streaming.api.connector.sink2 that return DataStream Modifier and Type Method Description DataStream<CommittableMessage<CommT>>WithPreCommitTopology. addPreCommitTopology(DataStream<CommittableMessage<CommT>> committables)Intercepts and modifies the committables sent on checkpoint or at end of input.DataStream<InputT>WithPreWriteTopology. addPreWriteTopology(DataStream<InputT> inputDataStream)Adds an arbitrary topology before the writer.Methods in org.apache.flink.streaming.api.connector.sink2 with parameters of type DataStream Modifier and Type Method Description static <CommT> voidStandardSinkTopologies. addGlobalCommitter(DataStream<CommittableMessage<CommT>> committables, org.apache.flink.util.function.SerializableSupplier<org.apache.flink.api.connector.sink2.Committer<CommT>> committerFactory, org.apache.flink.util.function.SerializableSupplier<org.apache.flink.core.io.SimpleVersionedSerializer<CommT>> committableSerializer)Adds a global committer to the pipeline that runs as final operator with a parallelism of one.voidWithPostCommitTopology. addPostCommitTopology(DataStream<CommittableMessage<CommT>> committables)Adds a custom post-commit topology where all committables can be processed.DataStream<CommittableMessage<CommT>>WithPreCommitTopology. addPreCommitTopology(DataStream<CommittableMessage<CommT>> committables)Intercepts and modifies the committables sent on checkpoint or at end of input.DataStream<InputT>WithPreWriteTopology. addPreWriteTopology(DataStream<InputT> inputDataStream)Adds an arbitrary topology before the writer. -
Uses of DataStream in org.apache.flink.streaming.api.datastream
Subclasses of DataStream in org.apache.flink.streaming.api.datastream Modifier and Type Class Description classCachedDataStream<T>CachedDataStreamrepresents aDataStreamwhose intermediate result will be cached at the first time when it is computed.classDataStreamSource<T>The DataStreamSource represents the starting point of a DataStream.classIterativeStream<T>The iterative data stream represents the start of an iteration in aDataStream.classKeyedStream<T,KEY>AKeyedStreamrepresents aDataStreamon which operator state is partitioned by key using a providedKeySelector.classSideOutputDataStream<T>ASideOutputDataStreamrepresents aDataStreamthat contains elements that are emitted from upstream into a side output with some tag.classSingleOutputStreamOperator<T>SingleOutputStreamOperatorrepresents a user defined transformation applied on aDataStreamwith one predefined output type.Fields in org.apache.flink.streaming.api.datastream declared as DataStream Modifier and Type Field Description protected DataStream<IN1>ConnectedStreams. inputStream1protected DataStream<IN2>ConnectedStreams. inputStream2Methods in org.apache.flink.streaming.api.datastream that return DataStream Modifier and Type Method Description <T> DataStream<T>CoGroupedStreams.WithWindow. apply(org.apache.flink.api.common.functions.CoGroupFunction<T1,T2,T> function)Completes the co-group operation with the user function that is executed for windowed groups.<T> DataStream<T>CoGroupedStreams.WithWindow. apply(org.apache.flink.api.common.functions.CoGroupFunction<T1,T2,T> function, org.apache.flink.api.common.typeinfo.TypeInformation<T> resultType)Completes the co-group operation with the user function that is executed for windowed groups.<T> DataStream<T>JoinedStreams.WithWindow. apply(org.apache.flink.api.common.functions.FlatJoinFunction<T1,T2,T> function)Completes the join operation with the user function that is executed for each combination of elements with the same key in a window.<T> DataStream<T>JoinedStreams.WithWindow. apply(org.apache.flink.api.common.functions.FlatJoinFunction<T1,T2,T> function, org.apache.flink.api.common.typeinfo.TypeInformation<T> resultType)Completes the join operation with the user function that is executed for each combination of elements with the same key in a window.<T> DataStream<T>JoinedStreams.WithWindow. apply(org.apache.flink.api.common.functions.JoinFunction<T1,T2,T> function)Completes the join operation with the user function that is executed for each combination of elements with the same key in a window.<T> DataStream<T>JoinedStreams.WithWindow. apply(org.apache.flink.api.common.functions.JoinFunction<T1,T2,T> function, org.apache.flink.api.common.typeinfo.TypeInformation<T> resultType)Completes the join operation with the user function that is executed for each combination of elements with the same key in a window.DataStream<T>DataStream. broadcast()Sets the partitioning of theDataStreamso that the output elements are broadcasted to every parallel instance of the next operation.DataStream<T>IterativeStream. closeWith(DataStream<T> feedbackStream)Closes the iteration.DataStream<F>IterativeStream.ConnectedIterativeStreams. closeWith(DataStream<F> feedbackStream)Closes the iteration.DataStream<T>DataStream. forward()Sets the partitioning of theDataStreamso that the output elements are forwarded to the local subtask of the next operation.DataStream<IN1>BroadcastConnectedStream. getFirstInput()Returns the non-broadcastDataStream.DataStream<IN1>ConnectedStreams. getFirstInput()Returns the firstDataStream.DataStream<IN2>ConnectedStreams. getSecondInput()Returns the secondDataStream.DataStream<T>DataStream. global()Sets the partitioning of theDataStreamso that the output values all go to the first instance of the next processing operator.<K> DataStream<T>DataStream. partitionCustom(org.apache.flink.api.common.functions.Partitioner<K> partitioner, int field)Deprecated.<K> DataStream<T>DataStream. partitionCustom(org.apache.flink.api.common.functions.Partitioner<K> partitioner, String field)Deprecated.<K> DataStream<T>DataStream. partitionCustom(org.apache.flink.api.common.functions.Partitioner<K> partitioner, org.apache.flink.api.java.functions.KeySelector<T,K> keySelector)Partitions a DataStream on the key returned by the selector, using a custom partitioner.DataStream<T>DataStream. rebalance()Sets the partitioning of theDataStreamso that the output elements are distributed evenly to instances of the next operation in a round-robin fashion.DataStream<T>DataStream. rescale()Sets the partitioning of theDataStreamso that the output elements are distributed evenly to a subset of instances of the next operation in a round-robin fashion.protected DataStream<T>DataStream. setConnectionType(StreamPartitioner<T> partitioner)Internal function for setting the partitioner for the DataStream.protected DataStream<T>KeyedStream. setConnectionType(StreamPartitioner<T> partitioner)DataStream<T>DataStream. shuffle()Sets the partitioning of theDataStreamso that the output elements are shuffled uniformly randomly to the next operation.DataStream<T>DataStream. union(DataStream<T>... streams)Creates a newDataStreamby mergingDataStreamoutputs of the same type with each other.Methods in org.apache.flink.streaming.api.datastream with parameters of type DataStream Modifier and Type Method Description DataStream<T>IterativeStream. closeWith(DataStream<T> feedbackStream)Closes the iteration.DataStream<F>IterativeStream.ConnectedIterativeStreams. closeWith(DataStream<F> feedbackStream)Closes the iteration.<T2> CoGroupedStreams<T,T2>DataStream. coGroup(DataStream<T2> otherStream)Creates a join operation.static <OUT> Iterator<OUT>DataStreamUtils. collect(DataStream<OUT> stream)Deprecated.Please useexecuteAndCollect().static <OUT> Iterator<OUT>DataStreamUtils. collect(DataStream<OUT> stream, String executionJobName)Deprecated.Please useexecuteAndCollect().static <E> List<E>DataStreamUtils. collectBoundedStream(DataStream<E> stream, String jobName)Deprecated.Please useexecuteAndCollect().static <E> List<E>DataStreamUtils. collectUnboundedStream(DataStream<E> stream, int numElements, String jobName)Deprecated.Please useexecuteAndCollect().static <OUT> ClientAndIterator<OUT>DataStreamUtils. collectWithClient(DataStream<OUT> stream, String jobExecutionName)Deprecated.Please useexecuteAndCollect().<R> ConnectedStreams<T,R>DataStream. connect(DataStream<R> dataStream)Creates a newConnectedStreamsby connectingDataStreamoutputs of (possible) different types with each other.static <T> DataStreamSink<T>DataStreamSink. forSink(DataStream<T> inputStream, org.apache.flink.api.connector.sink2.Sink<T> sink, CustomSinkOperatorUidHashes customSinkOperatorUidHashes)static <T> DataStreamSink<T>DataStreamSink. forSinkV1(DataStream<T> inputStream, org.apache.flink.api.connector.sink.Sink<T,?,?,?> sink, CustomSinkOperatorUidHashes customSinkOperatorUidHashes)<T2> JoinedStreams<T,T2>DataStream. join(DataStream<T2> otherStream)Creates a join operation.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. orderedWait(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit)Adds an AsyncWaitOperator.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. orderedWait(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit, int capacity)Adds an AsyncWaitOperator.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. orderedWaitWithRetry(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit, int capacity, AsyncRetryStrategy<OUT> asyncRetryStrategy)Adds an AsyncWaitOperator with an AsyncRetryStrategy to support retry of AsyncFunction.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. orderedWaitWithRetry(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit, AsyncRetryStrategy<OUT> asyncRetryStrategy)Adds an AsyncWaitOperator with an AsyncRetryStrategy to support retry of AsyncFunction.static <T,K>
KeyedStream<T,K>DataStreamUtils. reinterpretAsKeyedStream(DataStream<T> stream, org.apache.flink.api.java.functions.KeySelector<T,K> keySelector)static <T,K>
KeyedStream<T,K>DataStreamUtils. reinterpretAsKeyedStream(DataStream<T> stream, org.apache.flink.api.java.functions.KeySelector<T,K> keySelector, org.apache.flink.api.common.typeinfo.TypeInformation<K> typeInfo)DataStream<T>DataStream. union(DataStream<T>... streams)Creates a newDataStreamby mergingDataStreamoutputs of the same type with each other.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. unorderedWait(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit)Adds an AsyncWaitOperator.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. unorderedWait(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit, int capacity)Adds an AsyncWaitOperator.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. unorderedWaitWithRetry(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit, int capacity, AsyncRetryStrategy<OUT> asyncRetryStrategy)Adds an AsyncWaitOperator with an AsyncRetryStrategy to support retry of AsyncFunction.static <IN,OUT>
SingleOutputStreamOperator<OUT>AsyncDataStream. unorderedWaitWithRetry(DataStream<IN> in, AsyncFunction<IN,OUT> func, long timeout, TimeUnit timeUnit, AsyncRetryStrategy<OUT> asyncRetryStrategy)Adds an AsyncWaitOperator with an AsyncRetryStrategy to support retry of AsyncFunction.Constructors in org.apache.flink.streaming.api.datastream with parameters of type DataStream Constructor Description AllWindowedStream(DataStream<T> input, WindowAssigner<? super T,W> windowAssigner)BroadcastConnectedStream(StreamExecutionEnvironment env, DataStream<IN1> input1, BroadcastStream<IN2> input2, List<org.apache.flink.api.common.state.MapStateDescriptor<?,?>> broadcastStateDescriptors)BroadcastStream(StreamExecutionEnvironment env, DataStream<T> input, org.apache.flink.api.common.state.MapStateDescriptor<?,?>... broadcastStateDescriptors)CoGroupedStreams(DataStream<T1> input1, DataStream<T2> input2)Creates new CoGrouped data streams, which are the first step towards building a streaming co-group.ConnectedIterativeStreams(DataStream<I> input, org.apache.flink.api.common.typeinfo.TypeInformation<F> feedbackType, long waitTime)ConnectedStreams(StreamExecutionEnvironment env, DataStream<IN1> input1, DataStream<IN2> input2)IterativeStream(DataStream<T> dataStream, long maxWaitTime)JoinedStreams(DataStream<T1> input1, DataStream<T2> input2)Creates new JoinedStreams data streams, which are the first step towards building a streaming co-group.KeyedStream(DataStream<T> dataStream, org.apache.flink.api.java.functions.KeySelector<T,KEY> keySelector)Creates a newKeyedStreamusing the givenKeySelectorto partition operator state by key.KeyedStream(DataStream<T> dataStream, org.apache.flink.api.java.functions.KeySelector<T,KEY> keySelector, org.apache.flink.api.common.typeinfo.TypeInformation<KEY> keyType)Creates a newKeyedStreamusing the givenKeySelectorto partition operator state by key.StreamProjection(DataStream<IN> dataStream, int[] fieldIndexes)WithWindow(DataStream<T1> input1, DataStream<T2> input2, org.apache.flink.api.java.functions.KeySelector<T1,KEY> keySelector1, org.apache.flink.api.java.functions.KeySelector<T2,KEY> keySelector2, org.apache.flink.api.common.typeinfo.TypeInformation<KEY> keyType, WindowAssigner<? super CoGroupedStreams.TaggedUnion<T1,T2>,W> windowAssigner, Trigger<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> trigger, Evictor<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> evictor, Time allowedLateness)WithWindow(DataStream<T1> input1, DataStream<T2> input2, org.apache.flink.api.java.functions.KeySelector<T1,KEY> keySelector1, org.apache.flink.api.java.functions.KeySelector<T2,KEY> keySelector2, org.apache.flink.api.common.typeinfo.TypeInformation<KEY> keyType, WindowAssigner<? super CoGroupedStreams.TaggedUnion<T1,T2>,W> windowAssigner, Trigger<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> trigger, Evictor<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> evictor, Time allowedLateness) -
Uses of DataStream in org.apache.flink.streaming.api.environment
Methods in org.apache.flink.streaming.api.environment that return DataStream Modifier and Type Method Description DataStream<String>StreamExecutionEnvironment. readFileStream(String filePath, long intervalMillis, FileMonitoringFunction.WatchType watchType)Deprecated. -
Uses of DataStream in org.apache.flink.streaming.api.operators.collect
Constructors in org.apache.flink.streaming.api.operators.collect with parameters of type DataStream Constructor Description CollectStreamSink(DataStream<T> inputStream, CollectSinkOperatorFactory<T> factory) -
Uses of DataStream in org.apache.flink.streaming.api.transformations
Methods in org.apache.flink.streaming.api.transformations that return DataStream Modifier and Type Method Description DataStream<InputT>SinkTransformation. getInputStream()Constructors in org.apache.flink.streaming.api.transformations with parameters of type DataStream Constructor Description SinkTransformation(DataStream<InputT> inputStream, org.apache.flink.api.connector.sink2.Sink<InputT> sink, org.apache.flink.api.common.typeinfo.TypeInformation<OutputT> outputType, String name, int parallelism, boolean parallelismConfigured, CustomSinkOperatorUidHashes customSinkOperatorUidHashes)
-