Creating a Couchbase dSource using an offline backup (Couchbase Backup Manager)
Below is the brief architecture of Continuous Data Engine support for Couchbase database
Prerequisites: Access to production backup e.g.,:
/backup - archive
PROD - repository
/opt/couchbase/bin/cbbackupmgr info -a /backup -r PROD
Name | Size | # Backups |
PROD | 58.03MB | 1 |
+ Backup | Size | Type | Source | Cluster UUID | Range | Events | Aliases | Complete |
+ 2022-01-10T11_29_26.465860528-05_00 | 58.03MB | FULL | http://couchbasesrc.dlpxdc.co:8091 | 08f7937a26b2d20178a5ed16d7a2dd1c | N/A | 0 | 0 | true |
Login to Delphix Management application.
Click Manage > Datasets.
Select Add dSource.
In the Add dSource wizard, select the Couchbase source configuration which is created on the staging host.
Enter the Couchbase-specific parameters for your dSource configuration.
Select the dSource type Couchbase Backup Manager from the drop-down available on dSource wizard.
Enter the details for Staging Couchbase host - FQDN or IP address recommended.
Enter the details for Staging Port Number available on the staging host. The default port for couchbase is 8091.
Enter the details for Backup Location available on the staging host. For instance, if your Backup Path is specified as “/u01/couchbase/backups/,” the corresponding Backup Location should be set as “/u01/couchbase”.
Enter the details for Backup Archive Name.
If Backup Path is specified as “/u01/couchbase/backups/,” the corresponding Backup Archive Name should be set as “backups”.
If the Backup Archive Name field left empty then it will automatically ingest new full backups. The plugin will search for backup folders in the format %Y%m%d%H%M%S within Backup Location.
Enter the details for Backup repository
Enter the details for Mount Path available on the staging host. This empty folder acts as a base for NFS mounts.
Enter the details for Staging Cluster Name to setup new cluster on the staging host.
Enter the configuration details for your staging cluster as per resource availability on the staging host.
Cluster RAM Size
Cluster Index RAM Size
Cluster FTS RAM Size
Cluster Eventing RAM Size - this should be 0
Cluster Analysis RAM Size - this should be 0
Enter the details for Staging Cluster Admin User and Staging Cluster Admin Password.
Enter Bucket Size. A bucket size of zero means the connector will extract bucket size from the source database backup and apply the same in staging. Giving it any other value, would mean imposing that value on all buckets irrespective of the size in the source database.
Then click on Next button
Provide the details for dSource Name and Target group on the dSource configuration page.
On the Data management page, select the following:
Staging Environment: This will be your staging host where source config was created.
User: Database OS user with required privileges for linking the dataset.
On the next screens, configure a policy, hooks and review the configuration and click on Next button to view the summary.
Click the Submit button which will initiate the linking process.
Once dSource is created successfully, you can review the datasets on Manage > Datasets > dSource Name.