4.0.0
io.confluent
common
6.2.3
kafka-connect-elasticsearch
13.0.1
jar
kafka-connect-elasticsearch
Confluent, Inc.
http://confluent.io
http://confluent.io
Elasticsearch Sink Connector for Kafka Connect
Confluent Community License
http://www.confluent.io/confluent-community-license
repo
scm:git:git://github.com/confluentinc/kafka-connect-elasticsearch.git
scm:git:git@github.com:confluentinc/kafka-connect-elasticsearch.git
https://github.com/confluentinc/kafka-connect-elasticsearch
v13.0.1
7.17.1
1.3
2.28.2
2.9.0
1.16.3
0.11.1
2.5.3
3.3.1
2.0.0-M2
2.13.2.1
2.13.2
6.1.6
http://packages.confluent.io/maven/
1.15
confluent
Confluent
https://packages.confluent.io/maven/
org.apache.kafka
connect-api
provided
org.apache.kafka
connect-json
provided
org.elasticsearch.client
elasticsearch-rest-high-level-client
${es.version}
org.elasticsearch
elasticsearch
${es.version}
org.yaml
snakeyaml
org.apache.logging.log4j
log4j-api
2.17.1
com.fasterxml.jackson.dataformat
jackson-dataformat-cbor
commons-codec
commons-codec
1.15
org.apache.httpcomponents
httpclient
4.5.13
com.google.code.gson
gson
${gson.version}
test
commons-codec
commons-codec
1.15
commons-codec
commons-codec
${commons.codec.version}
org.hamcrest
hamcrest-all
${hamcrest.version}
test
org.mockito
mockito-inline
${mockito.version}
test
junit
junit
org.hamcrest
hamcrest-core
test
org.junit.jupiter
junit-jupiter-api
test
org.apache.kafka
connect-runtime
${kafka.version}
test
test-jar
test
io.confluent
confluent-log4j
test
org.apache.kafka
connect-runtime
${kafka.version}
test
org.apache.kafka
kafka-clients
${kafka.version}
test
test-jar
test
org.apache.kafka
kafka_${kafka.scala.version}
${kafka.version}
test
org.apache.kafka
kafka_${kafka.scala.version}
test-jar
test
test
${kafka.version}
org.testcontainers
elasticsearch
${test.containers.version}
test
org.apache.hadoop
hadoop-minikdc
${hadoop.version}
test
org.assertj
assertj-core
3.20.2
test
org.awaitility
awaitility
4.1.0
test
com.github.tomakehurst
wiremock-jre8
2.30.1
test
com.fasterxml.jackson.core
jackson-core
${jackson.version}
com.fasterxml.jackson.core
jackson-annotations
${jackson.version}
com.fasterxml.jackson.core
jackson-databind
${jackson.databind.version}
com.fasterxml.jackson
jackson-bom
${jackson.version}
import
pom
com.fasterxml.jackson.dataformat
jackson-dataformat-cbor
${jackson.version}
org.apache.maven.plugins
maven-failsafe-plugin
3.0.0-M3
io.confluent
${kafka.connect.maven.plugin.version}
kafka-connect-maven-plugin
kafka-connect
Kafka Connect Elasticsearch
https://docs.confluent.io/kafka-connect-elasticsearch/current/index.html
The Elasticsearch connector allows moving data from Kafka to Elasticsearch 2.x, 5.x, 6.x, and 7.x. It writes data from a topic in Kafka to an index in Elasticsearch and all data for a topic have the same type.
Elasticsearch is often used for text queries, analytics and as an key-value store (use cases). The connector covers both the analytics and key-value store use cases. For the analytics use case, each message is in Kafka is treated as an event and the connector uses topic+partition+offset as a unique identifier for events, which then converted to unique documents in Elasticsearch. For the key-value store use case, it supports using keys from Kafka messages as document ids in Elasticsearch and provides configurations ensuring that updates to a key are written to Elasticsearch in order. For both use cases, Elasticsearch’s idempotent write semantics guarantees exactly once delivery.
Mapping is the process of defining how a document, and the fields it contains, are stored and indexed. Users can explicitly define mappings for types in indices. When a mapping is not explicitly defined, Elasticsearch can determine field names and types from data, however, some types such as timestamp and decimal, may not be correctly inferred. To ensure that the types are correctly inferred, the connector provides a feature to infer a mapping from the schemas of Kafka messages.
logos/elasticsearch.jpg
Confluent, Inc.
supported by Confluent as part of a Confluent Platform subscription.]]>
https://docs.confluent.io/home/overview.html
logos/confluent.png
confluentinc
organization
Confluent, Inc.
https://confluent.io/
logos/confluent.png
sink
Elastic
elasticsearch
search
analytics
log
Elasticsearch 7.x
exactlyOnce
true
org.apache.maven.plugins
maven-compiler-plugin
true
-Xlint:all,-try
org.apache.maven.plugins
maven-assembly-plugin
src/assembly/development.xml
src/assembly/package.xml
make-assembly
package
single
org.apache.maven.plugins
maven-surefire-plugin
@{argLine} -Djava.awt.headless=true -Dtests.security.manager=false -Dtests.jarhell.check=false
org.apache.maven.plugins
maven-checkstyle-plugin
validate
validate
checkstyle/suppressions.xml
check
org.apache.maven.plugins
maven-release-plugin
${maven.release.plugin.version}
true
false
v@{project.version}
src/main/resources
true
standalone
maven-assembly-plugin
src/assembly/standalone.xml
jenkins
org.apache.maven.plugins
maven-failsafe-plugin
3.0.0-M3
**/ElasticsearchConnectorSslIT.java
licenses-package
org.codehaus.mojo
exec-maven-plugin
1.2.1
create-licenses
io.confluent.licenses.LicenseFinder
-i ${project.build.directory}/${project.build.finalName}-package/share/java/kafka-connect-elasticsearch
-o ${project.basedir}/licenses
-f
-h ${project.build.directory}/${project.build.finalName}-package/share/doc/kafka-connect-elasticsearch/licenses.html
-l ${project.build.directory}/${project.build.finalName}-package/share/doc/kafka-connect-elasticsearch/licenses
-n ${project.build.directory}/${project.build.finalName}-package/share/doc/kafka-connect-elasticsearch/notices
-t ${project.name}
-x licenses-${confluent.version}.jar
package
java
true
true
io.confluent
licenses
io.confluent
licenses
${confluent.version}
licenses-source
org.codehaus.mojo
exec-maven-plugin
1.2.1
create-licenses
io.confluent.licenses.LicenseFinder
-i ${project.build.directory}/${project.build.finalName}-development/share/java/kafka-connect-elasticsearch
-o ${project.basedir}/licenses
-f
-h ${project.basedir}/licenses.html
-l ${project.basedir}/licenses
-n ${project.basedir}/notices
-t ${project.name}
-x licenses-${confluent.version}.jar
package
java
true
true
io.confluent
licenses
io.confluent
licenses
${confluent.version}
maven-clean-plugin
3.0.0
.
licenses.html
licenses/*.*
notices/*.*