I have problem with the KAFKA Adapter that the replicat process abend when i add column to the table in the Source database. My understanding is that GG Kafka Adapter should handle it and update the schema in Kafka.
Error message
ERROR 2016-11-03 10:02:42,723 [main] The Avro Formatter formatOp operation failed.
org.apache.avro.AvroRuntimeException: Not a valid schema field: COL3_STRING
at org.apache.avro.generic.GenericData$Record.put(GenericData.java:125)
at oracle.goldengate.format.avro.AvroFormatter.formatColumnValue(AvroFormatter.java:370)
at oracle.goldengate.format.avro.AvroOperationFormatter.formatAfterValues(AvroOperationFormatter.java:275)
at oracle.goldengate.format.avro.AvroOperationFormatter.formatAfterValuesOp(AvroOperationFormatter.java:235)
at oracle.goldengate.format.avro.AvroOperationFormatter.formatOp(AvroOperationFormatter.java:159)
at oracle.goldengate.handler.kafka.KafkaHandler.formatOp(KafkaHandler.java:515)
at oracle.goldengate.handler.kafka.KafkaHandler.operationAdded(KafkaHandler.java:236)
at oracle.goldengate.datasource.DsEventManager$3.send(DsEventManager.java:455)
at oracle.goldengate.datasource.DsEventManager$EventDispatcher.distributeEvent(DsEventManager.java:231)
at oracle.goldengate.datasource.DsEventManager.fireOperationAdded(DsEventManager.java:463)
at oracle.goldengate.datasource.AbstractDataSource.fireOperationAdded(AbstractDataSource.java:464)
at oracle.goldengate.datasource.UserExitDataSource.addOperationToTransactionAndFireEvent(UserExitDataSource.java:1373)
at oracle.goldengate.datasource.UserExitDataSource.createOperation(UserExitDataSource.java:1341)
Error message in ggserror
2016-11-03 10:29:21 ERROR OGG-15051 Oracle GoldenGate Delivery, rkafka.prm: Java or JNI exception:
oracle.goldengate.util.GGException: Kafka Handler failed to format and process operation: table=[KT1.ST2], op pos=00000000230000001903, tx pos=00000000230000001903, op ts=2016-11-03 10:29:16.000118.
2016-11-03 10:29:21 ERROR OGG-01668 Oracle GoldenGate Delivery, rkafka.prm: PROCESS ABENDING.
custom_kafka_producer.properties
bootstrap.servers=localhost:9092
acks=1
compression.type=gzip
reconnect.backoff.ms=1000
value.serializer=org.apache.kafka.common.serialization.ByteArraySerializer
key.serializer=org.apache.kafka.common.serialization.ByteArraySerializer
# 100KB per partition
batch.size=102400
linger.ms=10000
kafka.prop
gg.handlerlist=kafkahandler
gg.handler.kafkahandler.type=kafka
gg.handler.kafkahandler.KafkaProducerConfigFile=custom_kafka_producer.properties
gg.handler.kafkahandler.TopicName=oggtopic
gg.handler.kafkahandler.format=avro_op
gg.handler.kafkahandler.SchemaTopicName=mySchemaTopic
gg.handler.kafkahandler.BlockingSend=false
gg.handler.kafkahandler.includeTokens=false
gg.handler.kafkahandler.topicPartitioning=table
gg.handler.kafkahandler.mode=op
goldengate.userexit.timestamp=utc
goldengate.userexit.writers=javawriter
javawriter.stats.display=TRUE
javawriter.stats.full=TRUE
gg.log=log4j
gg.log.level=DEBUG
gg.report.time=30sec
gg.classpath=dirprm/:/orabin/app/kafka/libs/*:
javawriter.bootoptions=-Xmx512m -Xms32m -Djava.class.path=ggjava/ggjava.jar