Skip to Main Content

GoldenGate

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

GoldenGate for kafka,why the replicat process write message to only one partition

3719323Jun 4 2018 — edited Jun 7 2018

Hi All:

     I'm using GoldenGate for BigData, the source is Oracle12C database, and the destination is kafka cluster.

     There is a topic named Test_Topic with 3 partitions.  a replication process named kktest.

     The problem is that kktest write the message only to Test_Topic partition[1],partition[0,2] is empty.This caused my KafkaSpout have only one work,and this is a bottleneck of the storm topology.

     Here is my custom_kafka_producer.properties:

     bootstrap.servers = vl-dev-8377.site:9092,vl-dev-8380.site:9092

     acks = 1

     reconnect.backoff.ms = 1000

     value.serializer = org.apache.kafka.common.serialization.ByteArraySerializer

     key.serializer = org.apache.kafka.common.serialization.ByteArraySerializer

     batch.size = 102400

     max.request.size = 5024000

     send.buffer.size = 5024000

Can anyone help me? Thanks a lot!

This post has been answered by Veera-Oracle on Jun 6 2018
Jump to Answer
Comments
Locked Post
New comments cannot be posted to this locked post.
Post Details
Locked on Jul 5 2018
Added on Jun 4 2018
6 comments
892 views