io.confluent.telemetry.events.exporter.kafka.async

Class AsyncKafkaExporter<T>

java.lang.Object

io.confluent.telemetry.events.exporter.kafka.async.AsyncKafkaExporter<T>

Type Parameters:

T -

All Implemented Interfaces:

Exporter<T>, AutoCloseable, org.apache.kafka.common.Configurable, org.apache.kafka.common.Reconfigurable

Direct Known Subclasses:

EventAsyncKafkaExporter

public class AsyncKafkaExporter<T>
extends Object
implements Exporter<T>

This KafkaExporter does not block the calling thread. It adds the data to a queue and returns immediately. A consumer thread drains the queue and sends the data to Kafka.

The exporter emit method returns a CompletableFuture object with a boolean that indicates if event has been sent or dropped, caller can either wait on the result and decide what to do based on result, or ignore the result.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AsyncKafkaExporter.Builder<T>

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AsyncKafkaExporter(int bufferSize, TopicSupplier<T> topicSupplier, org.apache.kafka.clients.producer.Producer<String,byte[]> producer, Function<T,org.apache.kafka.clients.producer.ProducerRecord<String,byte[]>> dataSerializer)
protected	AsyncKafkaExporter(Properties producerProperties, int bufferSize, TopicSupplier<T> topicSupplier, Function<T,org.apache.kafka.clients.producer.ProducerRecord<String,byte[]>> dataSerializer)

Method Summary

Modifier and Type	Method and Description
BlockingDeque<io.confluent.telemetry.events.exporter.kafka.async.AsyncKafkaExporter.Tuple<T>>	buffer()
void	close()
void	configure(Map<String,?> configs)
CompletableFuture<Boolean>	emit(T t) Filter and transform the events as appropriate and send to the specified destination.
static <T> AsyncKafkaExporter.Builder<T>	newBuilder()
Object	producer()
Set<String>	reconfigurableConfigs()
void	reconfigure(Map<String,?> configs)
void	validateReconfiguration(Map<String,?> configs)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.confluent.telemetry.events.exporter.Exporter

routeReady

Constructor Detail

AsyncKafkaExporter

protected AsyncKafkaExporter(int bufferSize,
                             TopicSupplier<T> topicSupplier,
                             org.apache.kafka.clients.producer.Producer<String,byte[]> producer,
                             Function<T,org.apache.kafka.clients.producer.ProducerRecord<String,byte[]>> dataSerializer)

AsyncKafkaExporter

protected AsyncKafkaExporter(Properties producerProperties,
                             int bufferSize,
                             TopicSupplier<T> topicSupplier,
                             Function<T,org.apache.kafka.clients.producer.ProducerRecord<String,byte[]>> dataSerializer)

Method Detail

newBuilder

public static <T> AsyncKafkaExporter.Builder<T> newBuilder()

reconfigurableConfigs

public Set<String> reconfigurableConfigs()

Specified by:

reconfigurableConfigs in interface org.apache.kafka.common.Reconfigurable

validateReconfiguration

public void validateReconfiguration(Map<String,?> configs)
                             throws org.apache.kafka.common.config.ConfigException

Specified by:

validateReconfiguration in interface org.apache.kafka.common.Reconfigurable

Throws:

org.apache.kafka.common.config.ConfigException

reconfigure

public void reconfigure(Map<String,?> configs)

Specified by:

reconfigure in interface org.apache.kafka.common.Reconfigurable

configure

public void configure(Map<String,?> configs)

Specified by:

configure in interface org.apache.kafka.common.Configurable

emit

public CompletableFuture<Boolean> emit(T t)

Description copied from interface: Exporter

Filter and transform the events as appropriate and send to the specified destination. This method takes care of batching, serialization and retries.

Specified by:

emit in interface Exporter<T>

Returns:

A CompletableFuture object with a Boolean value, indicates if event has been sent successfully

buffer

public BlockingDeque<io.confluent.telemetry.events.exporter.kafka.async.AsyncKafkaExporter.Tuple<T>> buffer()

close

public void close()

Specified by:

close in interface AutoCloseable

producer

public Object producer()