Skip to Main Content

GoldenGate

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Oracle Golden Gate Big Data (Cassandra) Replication Configuration Issue (Change logs are not getting

3505428Jul 17 2017 — edited Jul 21 2017

Hi,

I'm working on a POC to replicate data between Oracle 12c (source) and Cassandra 3.0.9 (target). I've a;ready configured manager, extract (capture and pump), replicat, and cassandra.properties.

Issue: Changes to 'employee' table in 'test' are not getting reflected in golden gate instance and hence trail file isn't getting pumped to target gg instance

Information is given below:

Source: Oracle 12c

Golden Gate Configuration

Manager Process:

PORT 7809

Autostart Extract E*

Extract Process

Extract esrc

SETENV (ORACLE_SID='orcl')

UserIdAlias orcl_user

TranlogOptions IntegratedParams (max_sga_size 256)

Exttrail ./dirdat/aa

ddl include all

ddloptions report

LOGALLSUPCOLS

UPDATERECORDFORMAT COMPACT

Table TEST.EMPLOYEE;

Data Pump Process

Extract  epmp

SETENV (ORACLE_SID='orcl')

UserIdAlias orcl_user

rmthost localhost, mgrport 7909

rmttrail ./dirdat/bb

table TEST.EMPLOYEE;

Target: Cassandra

Golden Gate for Big Data Configuration

Manager Process

Port 7909

DynamicPortList 7910-7930

PurgeOldExtracts ./dirdat/bb*, UseCheckPoints, MinKeepHours 2

Autostart Replicat C*

--AUTORESTART Replicat *, WaitMinutes 1, Retries 3

Replicat Process

REPLICAT cass

TARGETDB LIBFILE ggjava.dll SET property=dirprm/cassandra.properties

--SOURCEDEFS ./dirdef/dbo.def

getEnv (JAVA_HOME)

getEnv (PATH)

DDL INCLUDE ALL

GROUPTRANSOPS 1000

--MAPEXCLUDE dbo.excludetable

MAP TEST.EMPLOYEE, TARGET TEST.EMPLOYEE;

Cassandra.properties file

gg.handlerlist=cassandra

#The handler properties

gg.handler.cassandra.type=cassandra

gg.handler.cassandra.mode=op

gg.handler.cassandra.contactPoints=localhost

gg.handler.cassandra.ddlHandling=CREATE,ADD,DROP

gg.handler.cassandra.compressedUpdates=true

gg.handler.cassandra.cassandraMode=async

gg.handler.cassandra.consistencyLevel=ANY

goldengate.userexit.timestamp=utc

goldengate.userexit.writers=javawriter

javawriter.stats.display=TRUE

javawriter.stats.full=TRUE

gg.log=log4j

gg.log.level=DEBUG

gg.report.time=30sec

#Set the classpath here to the Datastax Cassandra Java Driver (3.1 latest)

#Link to the Cassandra drivers website

#http://cassandra.apache.org/doc/latest/getting_started/drivers.html#java

#Link to the Datastax Cassandra Java Driver

#https://github.com/datastax/java-driver

gg.classpath=C:\\PwC\\Test\\GoldenGate\\jars\\*

javawriter.bootoptions=-Xmx512m -Xms32m -Djava.class.path=ggjava/ggjava.jar

After configuration, I start manager on both source and target GG instances. Extract, Pump and Replicat processes are running without any errors. Now, I add a new record to my employee table. Expectation is golden gate will capture change logs and extract it into a trail file in ./dirdat/aa*. And pump process will transfer the trail file to ./dirdat/bb* folder in target gg instance. However, I don't see this behaviour.

Please let me know if I'm missing anything as I'm losing my sleep to figure out what is misconfigured.

Thanks in advance.

This post has been answered by K.Gan on Jul 21 2017
Jump to Answer
Comments
Locked Post
New comments cannot be posted to this locked post.
Post Details
Locked on Aug 18 2017
Added on Jul 17 2017
15 comments
857 views