Skip to Main Content

GoldenGate

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

OGG for BD->Kafka, Replicat problem

G ZMar 8 2017 — edited Mar 9 2017

Hi,

Following the article here:

https://www.confluent.io/blog/streaming-data-oracle-using-oracle-goldengate-kafka-connect/

and facing issue with replicate which created the Kafka topic automatically, but not other trail records are sent. DB version is 12.1 and GG is 12.2.0.1.1 and OGG_BigData is 12.2.0.1.

============================================================================

Configuration for the replicat:

REPLICAT rconf

TARGETDB LIBFILE libggjava.so SET property=dirprm/conf.props

REPORTCOUNT EVERY 1 MINUTES, RATE

GROUPTRANSOPS 1000

MAP *.*.*, TARGET *.*.*;

Configuration for the oggbd:

gg.handlerlist=confluent

#The handler properties

gg.handler.confluent.type=oracle.goldengate.kafkaconnect.KafkaConnectHandler

gg.handler.confluent.kafkaProducerConfigFile=confluent.properties

gg.handler.confluent.mode=tx

gg.handler.confluent.sourceRecordGeneratorClass=oracle.goldengate.kafkaconnect.DefaultSourceRecordGenerator

#The formatter properties

gg.handler.confluent.format=oracle.goldengate.kafkaconnect.formatter.KafkaConnectFormatter

gg.handler.confluent.format.insertOpKey=I

gg.handler.confluent.format.updateOpKey=U

gg.handler.confluent.format.deleteOpKey=D

gg.handler.confluent.format.treatAllColumnsAsStrings=false

gg.handler.confluent.format.iso8601Format=false

gg.handler.confluent.format.pkUpdateHandling=abend

goldengate.userexit.timestamp=utc

goldengate.userexit.writers=javawriter

javawriter.stats.display=TRUE

javawriter.stats.full=TRUE

gg.log=log4j

gg.log.level=trace

gg.report.time=30sec

#Set the classpath here

gg.classpath=dirprm/:/acfsmounts/acfs1/ogg_bd/ggjava/resources/lib*:/usr/share/java/kafka-connect-hdfs/*:/usr/share/java/kafka/*:/acfsmounts/acfs1/kafka-connect/bin/*

javawriter.bootoptions=-Xmx512m -Xms32m -Djava.class.path=.:ggjava/ggjava.jar:./dirprm

And kafka connector:

bootstrap.servers=192.168.3.187:9092

value.serializer=org.apache.kafka.common.serialization.ByteArraySerializer

key.serializer=org.apache.kafka.common.serialization.ByteArraySerializer

schema.registry.url=http://192.168.3.187:8081

value.converter=org.apache.kafka.connect.json.JsonConverter

key.converter=org.apache.kafka.connect.json.JsonConverter

internal.value.converter=org.apache.kafka.connect.json.JsonConverter

internal.key.converter=org.apache.kafka.connect.json.JsonConverter

============================================================================

DEBUG trace is attached.

Thanks,

Gjorgji

This post has been answered by G Z on Mar 9 2017
Jump to Answer
Comments
Locked Post
New comments cannot be posted to this locked post.
Post Details
Locked on Apr 6 2017
Added on Mar 8 2017
3 comments
1,026 views