Troubleshooting CockroachDB data sources

The CockroachDB connector produces three sets of logs during normal runtime. Refer to the list below to understand what they are and how you can access them.

CockroachDB Plugin logs

1. The CockroachDB connector is built using the plugin framework. Therefore, it adheres to Delphix Continuous Data’s standard plugin logging behavior. We recommend starting here for all troubleshooting. Refer to the Troubleshooting document for more information.

2. Plugin logs for CockroachDB are found at the below locations.

   CODE

   /{toolkit_directory}/Delphix_COMMON_{appliance_id}/plugin/sc:cockroach_{plugin-id}/CRDB/log_{os_user}/delphixCRDBDebug.log

CockroachDB Cluster logs

1. CockroachDB can write error messages to log files. The files are named using the following format:

   CODE

   cockroach.[host].[user].[start timestamp in UTC].[process ID].logCBBACKUPMGR.

2. To make it easier to watch a log without knowing the full filename, a symlink with the short filename cockroach.log is also created. {delphix_mount_path}/node<number>/logs/cockroach.log

3. This symlink points to the most recent log. The Cockroach log locations on staging or target host can be found at below locations:

   CODE

   {CockroachDB_install_path} version --build-tag
   For example: 
   /usr/local/bin/cockroach version --build-tag
   v21.2.2

4. Start CockroachDB multi-node cluster.

   CODE

   cockroach start --certs-dir=[path-to-certs-directory] 
   --advertise-addr=<node1 address> 
   --join=<node1 address>,<node2 address>,<node3 address> 
   --cache=.25 --max-sql-memory=.25

5. List CockroachDB certificate and keys.

   CODE

   cockroach cert list --certs-dir=[path-to-certs-directory]

6. Initialize a Cluster from any CockroachDB node.

   CODE

   cockroach init --certs-dir=[path-to-certs-directory] 
   --host=<address of any node on --join list>

7. Start interactive CockroachDB SQL shell.

   CODE

   cockroach sql --certs-dir=[path-to-certs-directory] 
   --host=<address of any cluster-node>:<cockroach_db_port>

Use the --certs-dir option with the valid path to the certificate directory of the CockroachDB cluster.

8. Find full backup subdirectories details.

SHOW BACKUPS IN 's3://{bucket name}/{path}?AWS_ACCESS_KEY_ID={placeholder}&AWS_SECRET_ACCESS_KEY={placeholder}';

9. Find full and incremental backups in a specific full backup subdirectory details.

   CODE

   SHOW BACKUP FROM LATEST IN 's3://{bucket name}?AWS_ACCESS_KEY_ID={placeholder}&AWS_SECRET_ACCESS_KEY={placeholder}';

10. Create CockroachDB User to login into CockroachDB console to access secure clusters.

    CODE

    create user dlpxadmin WITH PASSWORD 'dlpxadmin';

11. Grant access to CockroachDB User to access data.

    CODE

    GRANT SELECT, INSERT ON TABLE vehicles to dlpxadmin;