We have tried INIT and then CDC extracts and replicats for about 6 months. Two months ago, OGG version 21.14 was forcibly upgraded and we have struggled to good CDC stability since. Plus, since we cannot start a CDC extract at a previous point in time, then it means we need to completely refresh the target data with:
- CDC Extract (check it's running)
- INIT Extract
- INIT Replicat
- CDC Replicat (with HANDLECOLLISIONS)
I am checking to see if it is possible to do something even simpler. We do not need up-to-date data in our target every second of the day. So - how about the simple task of a complete refresh, daily. A truncate populate once a day. So, for our OCI GoldenGate deployments on 23ai, it would hopefully mean:
a) INIT extracts (of a MariaDB on AWS), set to auto restart every 24 hours (not just on failure), with PURGE param,
b) Paths to get the trail files over to our target deployment (Autonomous Database),
c) a truncate of the target tables ‘somewhere in the process’
d) parallel integrated Replicats to push the new exttrail data into the ADB.
I have tested the Extracts, and they seem good - create new, updated full versions of themselves on this schedule. However, it seems difficult to do the same, repeatable full REPLICATs daily. If I can do that, I can schedule a truncation via procedure in ORDS Scheduler if I have to. If there was something GG can do before the Replicat, then even better.
Has anyone done this seemingly simple task? Daily truncate and re-populate?