Patching GoldenGate with DBFS

There seems to be no consistency as to what directories should be on DBFS for when GoldenGate is implemented with RAC.

Here I will share my thoughts based on issues encountered.

oracle@test1:/opt/oracle/12.2.0/ggs01$ ggsci

Oracle GoldenGate Command Interpreter for Oracle
Version 12.2.0.1.170221 OGGCORE_12.2.0.1.0OGGBP_PLATFORMS_170123.1033_FBO
Linux, x64, 64bit (optimized), Oracle 11g on Jan 23 2017 21:54:15
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2017,  (more...)

How To Delete Integrated Extract Replicat

Why is this important?

If process is not unregistered from database, they are orphaned.

Hence:
unregister replicat DATABASE
unregister extract DATABASE

$ ./ggsci 

Oracle GoldenGate Command Interpreter for Oracle
Version 12.3.0.1.0 OGGCORE_12.3.0.1.0_PLATFORMS_170721.0154_FBO
Linux, x64, 64bit (optimized), Oracle 12c on Jul 21 2017 23:31:13
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.

GGSCI 1> info all

Program      (more...)

Performance Metric Service – Classic Configuration

Almost a year ago, Oracle released Oracle GoldenGate 12c (12.3.0.1.x). At that time, there were two architectures released; Microservices and Classic. Both architectures provided the same enterprise level replication. The only difference was that one enabled a RESTful API interface with HTML5 page and the other was still command line driven.

The biggest change though was with the addition of the Performance Metric Service/Server that come bundled with the core product. (more...)

Using GoldenGate LogDump To Find Bad Data

GoldenGate Primary Extract from source database captured data without any issues;

however, target was not able to consume the data since GoldenGate process would ABEND.

Unfortunately, I cannot provide all the details but high level.

Logdump 2433 >pos 0
+++ Starting with GoldenGate 12.2 TDR – Table Definition Record is in trail
+++ This will provide metadata for the table

Reading forward from RBA 0 
Logdump 2434 >SCANFORMETADATA
___________________________________________________________________ 
Hdr-Ind    :     E  (x45)      (more...)

Goldengate REPORTING P2

Previous post for Goldengate REPORTING

Goldengate reporting has to be the least implemented functionality until it is needed and often in hindsight.

Here is an example of what I would normally implement.

STATOPTIONS RESETREPORTSTATS
REPORT AT 00:01
REPORTROLLOVER AT 00:01
REPORTCOUNT EVERY 15 MINUTES, RATE
DISCARDROLLOVER AT 00:01 ON SUNDAY

If business only cares about monthly data, then would not make sense to collect daily nor would it make sense for business to request such.

DBFS Nightmare

====================================================================================================
How to cleanup DBFS tablespace after removing files at DBFS filesystem (Doc ID 2331565.1)	
====================================================================================================
High level overview of the DBMS_DBFS_SFS.REORGANIZEFS procedure:
----------------------------------------------------------------------------------------------------
1) Create a NEW tablespace
2) Create a temporary filesystem with dbms_dbfs_sfs.createFilesystem in the new tablespace.
3) Run dbms_dbfs_sfs.reorganizeFS -->>
   EXEC DBMS_DBFS_SFS.REORGANIZEFS(SRCSTORE=>'FS_FS1', DSTSTORE=>'FS_TMP_FS');
4) The dbfs data is now in the smaller NEW tablespace.
5) Drop the temporay filesystem with dbms_dbfs_sfs.dropFilesystem
6) The OLD original  (more...)

Build an Integrated Extract using JSON

Now that Oracle GoldenGate 12.3 Microservices have been out for about 9 month; there seems to be more and more discussions around how microservices can be used. The mircoservices architecture provides a faster way for users to build extract, replicats, distribution paths and many other items by using a JSON document and simply calling a REST end-point.

In this post, I’ll show you how to build an integrated extract using JSON and REST APIs. (more...)

Changing Security Role Password in Oracle GoldenGate 12.3 Microservices

One of the nice things about Oracle GoldenGate 12.3 Microserivces, is the flexibility we now have to interact with Oracle GoldenGate. Additionally, what comes with Oracle GoldenGate 12.3 Microservices is a new role based security frame work.

When you first setup Oracle GoldenGate 12.3 Microservices, you setup your ServiceManager and initial deployment. Upon setting this up, you will assign a new administrator to the frame work. This is a different user than (more...)

Start/Stop Extract/Replicat with REST API/JSON

Oracle GoldenGate Microservices Architecture is designed to allow the user to have three different ways of interacting with replication from anywhere. One of these approaches is to use the RESTful APIs that come bundled with release. By using RESTful APIs, an organization can orgistrate how they want GoldenGate to work within their environment.

In this post, you will take a look at how to start a pre-existing extract/replicat by using the RESTful API end points. (more...)

Managing the WINDOW_ID in Goldengate V11.2.1.0.33

When we import data into the landing schema on a Dat Warehouse via Goldengate, we add 3 fields to each record detailing when and how the record got loaded. This can be found in the *.inc files under $GG_HOME/dirinc on the target GG installation. An example of this is:
map xxx.DBA_GGCUTOVER_TEST, TARGET YYY.DBA_GGCUTOVER_TEST,  INSERTALLRECORDS, IGNOREDELETES
COLMAP (
USEDEFAULTS,
WINDOW_ID = @STRCAT(@GETENV(“RECORD”, “FILESEQNO”), @STRNUM(@GETENV(“RECORD”, “FILERBA”), RIGHTZERO, 10)),
OPER_TYPE = @GETENV (“GGHEADER”, “OPTYPE”),
CDC_LOAD_TIMESTAMP= (more...)

Troubleshoot Oracle GoldenGate Using Exception Handler

By default, a Replicat process ABENDS when the data being modified doesn’t exist in the target database. Learn how to troubleshoot Oracle GoldenGate Using Exception Handler mechanism. When this happens you need to troubleshoot the issue and correct it before the Replicat process can proceed. But this wouldn’t be easy, as sometimes it can take […]

The post Troubleshoot Oracle GoldenGate Using Exception Handler appeared first on VitalSoftTech.

OGG-02060: ENABLE_GOLDENGATE_REPLICATION is not set to true for Integrated Extract

When creating the GoldenGate Integrated Extract why do I get the message "ENABLE_GOLDENGATE_REPLICATION is not set to true"?

The post OGG-02060: ENABLE_GOLDENGATE_REPLICATION is not set to true for Integrated Extract appeared first on VitalSoftTech.

OGG-02060 The Oracle Mining Database is not Configured Properly to Support Integrated Capture.

When creating the GoldenGate Integrated Extract I get the OGG-02060 error. How do I resolve it?

The post OGG-02060 The Oracle Mining Database is not Configured Properly to Support Integrated Capture. appeared first on VitalSoftTech.

Want to SPEED Up Your Database Tasks? DBMS_PARALLEL_EXECUTE to the rescue!

Use DBMS_PARALLEL_EXECUTE to divide one huge task into multiple small tasks that can be executed at the same time. See how many ways are there to divide.

The post Want to SPEED Up Your Database Tasks? DBMS_PARALLEL_EXECUTE to the rescue! appeared first on VitalSoftTech.

GoldenGate Not Keeping Up? Split the Process Using GoldenGate Range Function

In most environments one set of GoldenGate process (1 Extract & 1 Replicat process) is sufficient for change data synchronization. But if your source database generates a huge volume of data then a single process may not be sufficient to handle the data volume. In such a scenario there may be need to split the […]

The post GoldenGate Not Keeping Up? Split the Process Using GoldenGate Range Function appeared first on VitalSoftTech.

GoldenGate Active-Active Database Replication with Conflict Detection and Resolution

Bi-Directional Replication also known as Active-Active Replication, is a configuration where both databases are used as an active site and applications perform DML/DDL activities on both Databases. The OGG processes is configured to replicate the transaction data of both the source databases back and forth to each other. 1. Advantages Bi-directional GoldenGate Replication can be […]

The post GoldenGate Active-Active Database Replication with Conflict Detection and Resolution appeared first on VitalSoftTech.

Oracle GoldenGate Data Transformation

Oracle GoldenGate supports data mapping and manipulation. It is done by using options of Table (Extract) and Map (Replicat) parameters. By default OGG assumes that SOURCE and TARGET table definitions are same that part of replication.

The post Oracle GoldenGate Data Transformation appeared first on VitalSoftTech.

Oracle VM VirtualBox Tutorial: Connecting Applications from your Desktop to a database on VirtualBox

If you have your Oracle VM VirtualBox setup and running there is a possibility that you may need to setup the network for the Virtual Machine to make it accessible from the host machine (Desktop or Laptop). This may be needed when you want to connect your local applications to the database running on the VM VirtualBox.

The post Oracle VM VirtualBox Tutorial: Connecting Applications from your Desktop to a database on VirtualBox appeared first (more...)

How to Provision Oracle VM VirtualBox using Pre-Built Developer VMs

The post How to Provision Oracle VM VirtualBox using Pre-Built Developer VMs appeared first on VitalSoftTech.

Learn GoldenGate – The Index

Learn about GoldenGate Extract, Pump, Replicat, GGSCI, Logdump, Troubleshooting and Upgrade.

The post Learn GoldenGate – The Index appeared first on VitalSoftTech.