Oracle Cloud Infrastructure

Oracle 11g – let’s move that old Stuff to the Oracle Cloud

Author: Martin Berger 2. November 2021

This blog post describes the lift and shift of an on-prem Oracle 11g Enterprise Edition to Oracle Cloud Infrastructure by using Oracle RMAN paired with OCI Object Storage. Works for other versions > Oracle 11g / Enterprise Edition too (the tablespace encryption method may change).

Architecture

Q&A

What’s the motivation of the lift and shift of a good old on-prem Oracle 11g database to Oracle Database Service?

Hardware runs out of lifecycle
Out scoping of an on-prem database which is only used for several times to compare old data
Regulatory, for example we have the keep and access the data for 10 yrs
Changing from on-prem licenses to the license included model
Upgrade tests for 19c and convert to Multitenancy Architecture
Part of company’s cloud strategy

Why using the OCI database service instead of a cheaper compute instance?

Only the database service allows tablespace encryption without any additional costs in the license included model. From my point of view, this is a must when running Oracle databases outside of the on-prem datacenter in any cloud. And for this case, 11g to 11g, it fit’s best without any configuration overhead. And finally, the root OS access gives me flexibility.

Are the other methods available than using RMAN backup/restore/recovery with the Oracle Database Backup Service?

Sure, according the Oracle docs:

Golden Gate
Data Transfer Service
Oracle Data Pump
Database Migration Service
RMAN Transportable Tablespaces

Why I like the Oracle Database Backup Cloud Service?

The on-prem RMAN backups have to be encrypted, no encryption, no Database Backup Service.
The configuration of the Backup Service Module is not really complicated, well documented and can be used 1:1 in on-prem and in the cloud. For 11.2.0.4,I need to install on-prem a patch to encrypt the backups (18339044 – RMAN-06770: backup encryption requires Enterprise Edition).
The backup configuration can be done in advanced without any pressure, the target database can be recovered at any time. This reduces once the restore is done the downtime when the final move should be done. Backing up an Oracle database by RMAN locally and to the cloud can co-exist without any problems.
The backup is stored in the Object Storage. With a replication policy, I can rebuild a new database in another region in an easy way.
Oracle Database Backup Module allows proxy configurations to backup to the cloud.

Links and My Oracle Support Notes

BACKUP AND RECOVERY IN ORACLE CLOUD FOR DOCKER CONTAINER DEPLOYED DATABASE (Doc ID 2772375.1)
Oracle Database Tablespace Encryption Behavior in Oracle Cloud (Doc ID 2359020.1)
https://docs.oracle.com/en-us/iaas/Content/Database/Tasks/mig-11g-11g.htm
https://docs.oracle.com/en-us/iaas/Content/Database/Tasks/mig-onprembackup.htm
https://docs.oracle.com/en/cloud/paas/db-backup-cloud/csdbb/installing-oracle-database-cloud-backup-module-oci-classic.html
https://docs.oracle.com/en/cloud/paas/db-backup-cloud/csdbb/restoring-new-database-host.html

Migration Steps

Create OCI Object Storage
Configure on-prem database to use the Oracle Database Backup Service
Create a new OCI Database Virtual Machine
Configure OCI cloud database to use the Oracle Database Backup Service
Clean up OCI cloud database
Restore OCI cloud database from Object Store
Encrypt tablespace

1. OCI Object Storage

A Object storage bucked called onprem-bucket is created in region eu-zurich-1:

2. Configure on-prem database to use the Oracle Database Backup Service

The installation of the Backup Service is described in this link here, you can download the OCI Backup Service Module: www.oracle.com/technetwork/database/availability/oracle-cloud-backup-2162729.html

On-Prem Database – Specifications

11.2.0.4 Enterprise Edition
Database name DB11
Oracle Linux 7.9
About 60GB size
Oracle Backup Service to Object Storage enabled and configured
Regular RMAN inc0, inc1c and arc backups to the Cloud
Enabled RMAN compression and encryption (for the usage of the Backup Service the license is included)
Backup encrypted by password

On-Prem Database – Tablespaces and Datafiles

SQL> COL tablespace_name FORMAT a20
SQL> COL file_name FORMAT a70
SQL> SET LINES 300

SQL> SELECT tablespace_name, file_name
2 FROM dba_data_files
3 ORDER BY 1;

TABLESPACE_NAME FILE_NAME
-------------------- ----------------------------------------------------------------------
HRDATA               /u02/oradata/DB11/DB11/datafile/o1_mf_hrdata_jq2x77dc_.dbf
SHDATA               /u02/oradata/DB11/DB11/datafile/o1_mf_shdata_jq4mqyyl_.dbf
SOEDATA              /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp7sy_.dbf
SOEDATA              /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jq2x7f6v_.dbf
SOEDATA              /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp4ol_.dbf
SYSAUX               /u02/oradata/DB11/DB11/datafile/o1_mf_sysaux_jpdvb315_.dbf
SYSTEM               /u02/oradata/DB11/DB11/datafile/o1_mf_system_jpdvb09z_.dbf
UNDOTBS1             /u02/oradata/DB11/DB11/datafile/o1_mf_undotbs1_jpdvb513_.dbf
USERS                /u02/oradata/DB11/DB11/datafile/o1_mf_users_jpdvbbh5_.dbf

9 rows selected.

SQL> COL tablespace_name FORMAT a20

SQL> COL file_name FORMAT a70

SQL> SET LINES 300

SQL> SELECT tablespace_name, file_name

2 FROM dba_data_files

3 ORDER BY 1;

TABLESPACE_NAME FILE_NAME

-------------------- ----------------------------------------------------------------------

HRDATA /u02/oradata/DB11/DB11/datafile/o1_mf_hrdata_jq2x77dc_.dbf

SHDATA /u02/oradata/DB11/DB11/datafile/o1_mf_shdata_jq4mqyyl_.dbf

SOEDATA /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp7sy_.dbf

SOEDATA /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jq2x7f6v_.dbf

SOEDATA /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp4ol_.dbf

SYSAUX /u02/oradata/DB11/DB11/datafile/o1_mf_sysaux_jpdvb315_.dbf

SYSTEM /u02/oradata/DB11/DB11/datafile/o1_mf_system_jpdvb09z_.dbf

UNDOTBS1 /u02/oradata/DB11/DB11/datafile/o1_mf_undotbs1_jpdvb513_.dbf

USERS /u02/oradata/DB11/DB11/datafile/o1_mf_users_jpdvbbh5_.dbf

9 rows selected.

On-Prem Database – RMAN Backup to Oracle Cloud Infrastructure

Example RMAN Output where the media is the Oracle Cloud Infrastructure Object Storage in Zurich / Switzerland.

RMAN> LIST BACKUPSET 542;

List of Backup Sets
===================

BS Key Type LV Size Device Type Elapsed Time Completion Time
------- ---- -- ---------- ----------- ------------ ---------------
542 Incr 0 13.23G SBT_TAPE 00:15:29 31-OCT-21
BP Key: 542 Status: AVAILABLE Compressed: YES Tag: TAG20211031T043005
Handle: /u01/app/oracle/admin/DB11/backup/inc0_DB11_2021-10-31_04-30-03_s544_p1 Media: objectstorage.eu-zurich-..cloud.com/n/zrq012abcaw/onprem-bucket
List of Datafiles in backup set 542
File LV Type Ckp SCN    Ckp Time  Name
---- -- ---- ---------- --------- ----
1    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_system_jpdvb09z_.dbf
2    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_sysaux_jpdvb315_.dbf
3    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_undotbs1_jpdvb513_.dbf
4    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_users_jpdvbbh5_.dbf
5    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_hrdata_jq2x77dc_.dbf
6    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jq2x7f6v_.dbf
7    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_shdata_jq4mqyyl_.dbf
8    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp4ol_.dbf
9    0  Incr 1720448    31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp7sy_.dbf

RMAN> LIST BACKUPSET 542;

List of Backup Sets

===================

BS Key Type LV Size Device Type Elapsed Time Completion Time

------- ---- -- ---------- ----------- ------------ ---------------

542 Incr 0 13.23G SBT_TAPE 00:15:29 31-OCT-21

BP Key: 542 Status: AVAILABLE Compressed: YES Tag: TAG20211031T043005

Handle: /u01/app/oracle/admin/DB11/backup/inc0_DB11_2021-10-31_04-30-03_s544_p1 Media: objectstorage.eu-zurich-..cloud.com/n/zrq012abcaw/onprem-bucket

List of Datafiles in backup set 542

File LV Type Ckp SCN Ckp Time Name

---- -- ---- ---------- --------- ----

1 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_system_jpdvb09z_.dbf

2 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_sysaux_jpdvb315_.dbf

3 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_undotbs1_jpdvb513_.dbf

4 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_users_jpdvbbh5_.dbf

5 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_hrdata_jq2x77dc_.dbf

6 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jq2x7f6v_.dbf

7 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_shdata_jq4mqyyl_.dbf

8 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp4ol_.dbf

9 0 Incr 1720448 31-OCT-21 /u02/oradata/DB11/DB11/datafile/o1_mf_soedata_jqrfp7sy_.dbf

3. Create a new OCI Database Virtual Machine

A new 11g Oracle Database virtual machine is created, license included. 11g is not available for Logical Volumes unfortunately, therefore we need to use Grid Infrastructure.

Cloud Database – Specifications

11.2.0.4 Enterprise Edition Database Virtual Machine
Oracle Linux 7.9
Grid Infrastructure (11g is not available for Logical Volumes unfortunately)
Database Name is DB11
Connected from the on-prem data center a) by VPN or b) by SSH-Tunnel via Bastion Host

Cloud Database – Controlfile, Tablespaces and Datafiles

[oracle@db11-cloud-12 ~]$ . oraenv
ORACLE_SID = [DB11] ?
The Oracle base has been set to /u01/app/oracle

[oracle@db11-cloud-12 ~]$ . oraenv

ORACLE_SID = [DB11] ?

The Oracle base has been set to /u01/app/oracle

[oracle@db11-cloud-12 ~]$ sqlplus / as sysdba

1	[oracle@db11-cloud-12 ~]$ sqlplus / as sysdba

Query controlfile information.

SQL> SELECT name FROM v$controlfile;

NAME
--------------------------------------------------------------------------------
+RECO/db11_zrh1ws/controlfile/current.256.1087481145

SQL> SELECT name FROM v$controlfile;

NAME

--------------------------------------------------------------------------------

+RECO/db11_zrh1ws/controlfile/current.256.1087481145

Query datafile information. The existing datafiles will be dropped later before the restore starts.

SQL> COL tablespace_name FORMAT a20
SQL> COL file_name FORMAT a70
SQL> SET LINES 300

SQL> SELECT tablespace_name, file_name
  2> FROM dba_data_files
  3> ORDER BY 1;

TABLESPACE_NAME FILE_NAME
-------------------- ----------------------------------------------------------------------
SYSAUX               +DATA/db11_zrh1ws/datafile/sysaux.262.1087481085
SYSTEM               +DATA/db11_zrh1ws/datafile/system.261.1087481085
UNDOTBS1             +DATA/db11_zrh1ws/datafile/undotbs1.263.1087481085
USERS                +DATA/db11_zrh1ws/datafile/users.266.1087481469

SQL> COL tablespace_name FORMAT a20

SQL> COL file_name FORMAT a70

SQL> SET LINES 300

SQL> SELECT tablespace_name, file_name

2> FROM dba_data_files

3> ORDER BY 1;

TABLESPACE_NAME FILE_NAME

-------------------- ----------------------------------------------------------------------

SYSAUX +DATA/db11_zrh1ws/datafile/sysaux.262.1087481085

SYSTEM +DATA/db11_zrh1ws/datafile/system.261.1087481085

UNDOTBS1 +DATA/db11_zrh1ws/datafile/undotbs1.263.1087481085

USERS +DATA/db11_zrh1ws/datafile/users.266.1087481469

Query tablespace information for encryption, the USERS tablespace is already encrypted. Encryption of SYSTEM, SYSAUX etc. is introduced in a later Oracle version and not available in 11g.

SQL> SELECT tablespace_name, encrypted FROM dba_tablespaces;

TABLESPACE_NAME ENC
------------------------------ ---
SYSTEM                         NO
SYSAUX                         NO
UNDOTBS1                       NO
TEMP                           NO
USERS                          YES

SQL> SELECT tablespace_name, encrypted FROM dba_tablespaces;

TABLESPACE_NAME ENC

------------------------------ ---

SYSTEM NO

SYSAUX NO

UNDOTBS1 NO

TEMP NO

USERS YES

4. Configure OCI Cloud Database to use the Oracle Database Backup Service

Note: When the database is located in a VCN private subnet, to install and using the Oracle Database Backup Service module you have to configure these two resources:

Service Gateway for Object Storage access
NAT Gateway used by the Database Backup Service Module Library installation routine

For the installation the SSH private key from the existing on-prem Database Backup Service configuration is required and has to be transferred to cloud server. The fingerprint of the public ssh key is required.

A list of object storage endpoints is avaliable here: Object Storage Service API | Oracle Cloud Infrastructure API Reference and Endpoints

Cloud Database – Oracle Database Backup Service Installation and Configuration

[opc@db11-cloud-12 ~]$ sudo su - oracle

1	[opc@db11-cloud-12 ~]$ sudo su - oracle

Create directory for the Database Backup Module installation, transfer and extract it.

[oracle@db11-cloud-12 ~]$ mkdir -p /u01/app/oracle/oci
[oracle@db11-cloud-12 ~]$ cd /u01/app/oracle/oci

[oracle@db11-cloud-12 oci]$ ll
total 1776
-rw-r--r-- 1 oracle oinstall 1816114 Nov 1 14:29 opc_installer.zip

[oracle@db11-cloud-12 oci]$ unzip opc_installer.zi

[oracle@db11-cloud-12 ~]$ mkdir -p /u01/app/oracle/oci

[oracle@db11-cloud-12 ~]$ cd /u01/app/oracle/oci

[oracle@db11-cloud-12 oci]$ ll

total 1776

-rw-r--r-- 1 oracle oinstall 1816114 Nov 1 14:29 opc_installer.zip

[oracle@db11-cloud-12 oci]$ unzip opc_installer.zi

Create directories for wallet and library.

[oracle@db11-cloud-12 ~]$ mkdir -p /u01/app/oracle/oci/oci_wallet/
[oracle@db11-cloud-12 ~]$ mkdir -p /u01/app/oracle/oci/lib/

1 2	[oracle@db11-cloud-12 ~]$ mkdir -p /u01/app/oracle/oci/oci_wallet/ [oracle@db11-cloud-12 ~]$ mkdir -p /u01/app/oracle/oci/lib/

Transfer the SSH key from on-prem to the cloud virtual machine into oci_wallet directory.

[oracle@db11-cloud-12 oci]$ ll /u01/app/oracle/oci/oci_wallet/
total 4
-rw-r--r-- 1 oracle oinstall 1703 Nov 1 14:31 oci_pvt

[oracle@db11-cloud-12 oci]$ ll /u01/app/oracle/oci/oci_wallet/

total 4

-rw-r--r-- 1 oracle oinstall 1703 Nov 1 14:31 oci_pvt

Install Oracle Backup Service Module, use the private key and public fingerprint from the on-prem installation. Set environment and start the installer. Use the bucket name from OCI Object Storage bucket which you have created first.

[oracle@db11-cloud-12 stage]$ . oraenv
ORACLE_SID = [DB11] ?
The Oracle base has been set to /u01/app/oracle

[oracle@db11-cloud-12 stage]$ . oraenv

ORACLE_SID = [DB11] ?

The Oracle base has been set to /u01/app/oracle

[oracle@db11-cloud-12 oci]$ java -jar /u01/app/oracle/oci/opc_installer/oci_installer/oci_install.jar \
-host https://objectstorage.eu-zurich-1.oraclecloud.com \
-uOCID ocid1.user.oc1..aaaaaaaaeif6sfiwfjukvylfs6ps34gypvep4703Mohnweg \
-tOCID ocid1.tenancy.oc1..aaaaaaaaxuk4je4t3aorovuzmwyeaq5sftqv3nkyz64sni4703Mohnweg \
-walletDir /u01/app/oracle/oci/oci_wallet \
-libDir /u01/app/oracle/oci/lib \
-pvtKeyFile /u01/app/oracle/oci/oci_wallet/oci_pvt \
-pubfingerprint 16:48:7b:21:f0:31:74:9e:t3:u8:v2:w9:x1:y9:zd:77 \
-bucket onprem-bucket

[oracle@db11-cloud-12 oci]$ java -jar /u01/app/oracle/oci/opc_installer/oci_installer/oci_install.jar \

-host https://objectstorage.eu-zurich-1.oraclecloud.com \

-uOCID ocid1.user.oc1..aaaaaaaaeif6sfiwfjukvylfs6ps34gypvep4703Mohnweg \

-tOCID ocid1.tenancy.oc1..aaaaaaaaxuk4je4t3aorovuzmwyeaq5sftqv3nkyz64sni4703Mohnweg \

-walletDir /u01/app/oracle/oci/oci_wallet \

-libDir /u01/app/oracle/oci/lib \

-pvtKeyFile /u01/app/oracle/oci/oci_wallet/oci_pvt \

-pubfingerprint 16:48:7b:21:f0:31:74:9e:t3:u8:v2:w9:x1:y9:zd:77 \

-bucket onprem-bucket

Installer Output.

Oracle Database Cloud Backup Module Install Tool, build 19.3.0.0.0DBBKPCSBP_2019-10-16
Oracle Database Cloud Backup Module credentials are valid.
Backups would be sent to bucket onprem-bucket.
Oracle Database Cloud Backup Module wallet created in directory /u01/app/oracle/oci/oci_wallet.
Oracle Database Cloud Backup Module initialization file /u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora created.
Downloading Oracle Database Cloud Backup Module Software Library from Oracle Cloud Infrastructure.
Download complete.

Oracle Database Cloud Backup Module Install Tool, build 19.3.0.0.0DBBKPCSBP_2019-10-16

Oracle Database Cloud Backup Module credentials are valid.

Backups would be sent to bucket onprem-bucket.

Oracle Database Cloud Backup Module wallet created in directory /u01/app/oracle/oci/oci_wallet.

Oracle Database Cloud Backup Module initialization file /u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora created.

Downloading Oracle Database Cloud Backup Module Software Library from Oracle Cloud Infrastructure.

Download complete.

A new parameter file is created which contains the OCI Object Storage information. This configuration file is used later in RMAN.

[oracle@db11-cloud-12 oci]$ cat $ORACLE_HOME/dbs/opcDB11.ora
OPC_HOST=https://objectstorage.eu-zurich-1.oraclecloud.com/n/zrq07abcdefgh
OPC_WALLET='LOCATION=file:/u01/app/oracle/oci/oci_wallet CREDENTIAL_ALIAS=alias_oci'
OPC_CONTAINER=onprem-bucket
OPC_COMPARTMENT_ID=ocid1.compartment.oc1..aaaaaaaat5uo2xh77edws4huwvqorengp7x4xdv6x3giw3vr4703Mohnweg
OPC_AUTH_SCHEME=BMC

[oracle@db11-cloud-12 oci]$ cat $ORACLE_HOME/dbs/opcDB11.ora

OPC_HOST=https://objectstorage.eu-zurich-1.oraclecloud.com/n/zrq07abcdefgh

OPC_WALLET='LOCATION=file:/u01/app/oracle/oci/oci_wallet CREDENTIAL_ALIAS=alias_oci'

OPC_CONTAINER=onprem-bucket

OPC_COMPARTMENT_ID=ocid1.compartment.oc1..aaaaaaaat5uo2xh77edws4huwvqorengp7x4xdv6x3giw3vr4703Mohnweg

OPC_AUTH_SCHEME=BMC

5. Clean up OCI Cloud Database and restart NOMOUNT

[opc@db11-cloud-12 ~]$ sudo su - grid

1	[opc@db11-cloud-12 ~]$ sudo su - grid

Set environment to database DB11.

[grid@db11-cloud-12 ~]$ . oraenv
ORACLE_SID = [+ASM1] ? DB11
The Oracle base has been set to /u01/app/oracle

[grid@db11-cloud-12 ~]$ . oraenv

ORACLE_SID = [+ASM1] ? DB11

The Oracle base has been set to /u01/app/oracle

Shutdown the database instance by using the database unique name.

[grid@db11-cloud-12 ~]$ srvctl status database -d db11_zrh1ws
Instance DB11 is running on node db11-cloud-12

[grid@db11-cloud-12 ~]$ srvctl stop database -d db11_zrh1ws

[grid@db11-cloud-12 ~]$ srvctl status database -d db11_zrh1ws
Instance DB11 is not running on node db11-cloud-12

[grid@db11-cloud-12 ~]$ srvctl status database -d db11_zrh1ws

Instance DB11 is running on node db11-cloud-12

[grid@db11-cloud-12 ~]$ srvctl stop database -d db11_zrh1ws

[grid@db11-cloud-12 ~]$ srvctl status database -d db11_zrh1ws

Instance DB11 is not running on node db11-cloud-12

Error message when environment for +ASM is set:

[grid@db11-cloud-12 ~]$ srvctl stop database -d db11_zrh1ws
PRCD-1229 : An attempt to access configuration of database db11_zrh1ws was rejected because its version 11.2.0.4.0 differs from the program version 19.0.0.0.0. Instead run the program from /u01/app/oracle/product/11.2.0.4/dbhome_1.

1 2	[grid@db11-cloud-12 ~]$ srvctl stop database -d db11_zrh1ws PRCD-1229 : An attempt to access configuration of database db11_zrh1ws was rejected because its version 11.2.0.4.0 differs from the program version 19.0.0.0.0. Instead run the program from /u01/app/oracle/product/11.2.0.4/dbhome_1.

ASM Cleanup with environment +ASM – you have to add ORACLE_HOME manually

[grid@db11-cloud-12 ~]$ . oraenv
ORACLE_SID = [DB11] ? +ASM
ORACLE_HOME = [/home/oracle] ? /u01/app/19.0.0.0/grid
The Oracle base has been changed from /u01/app/oracle to /u01/app/grid

[grid@db11-cloud-12 ~]$ . oraenv

ORACLE_SID = [DB11] ? +ASM

ORACLE_HOME = [/home/oracle] ? /u01/app/19.0.0.0/grid

The Oracle base has been changed from /u01/app/oracle to /u01/app/grid

[grid@db11-cloud-12 ~]$ asmcmd
ASMCMD> cd RECO
ASMCMD> rm -rf DB11_ZRH1WS/
ASMCMD> cd ..
ASMCMD> cd DATA
ASMCMD> cd DB11_ZRH1WS

[grid@db11-cloud-12 ~]$ asmcmd

ASMCMD> cd RECO

ASMCMD> rm -rf DB11_ZRH1WS/

ASMCMD> cd ..

ASMCMD> cd DATA

ASMCMD> cd DB11_ZRH1WS

ASMCMD> ls -l
Type Redund Striped Time Sys Name
Y DATAFILE/
Y PARAMETERFILE/
Y TEMPFILE/
PARAMETERFILE UNPROT COARSE NOV 01 14:00:00 N spfileDB11.ora => +DATA/DB11_ZRH1WS/PARAMETERFILE/spfile.265.1087481321

ASMCMD> ls -l

Type Redund Striped Time Sys Name

Y DATAFILE/

Y PARAMETERFILE/

Y TEMPFILE/

PARAMETERFILE UNPROT COARSE NOV 01 14:00:00 N spfileDB11.ora => +DATA/DB11_ZRH1WS/PARAMETERFILE/spfile.265.1087481321

ASMCMD> rm -rf DATAFILE/
ASMCMD> rm -rf TEMPFILE/

1 2	ASMCMD> rm -rf DATAFILE/ ASMCMD> rm -rf TEMPFILE/

Set environment to DB11.

[grid@db11-cloud-12 ~]$ . oraenv
ORACLE_SID = [+ASM] ? DB11
The Oracle base has been changed from /u01/app/grid to /u01/app/oracle

[grid@db11-cloud-12 ~]$ . oraenv

ORACLE_SID = [+ASM] ? DB11

The Oracle base has been changed from /u01/app/grid to /u01/app/oracle

Start database NOMOUNT.

[grid@db11-cloud-12 ~]$ srvctl start database -d db11_zrh1ws -o nomount
[grid@db11-cloud-12 ~]$ srvctl status database -d db11_zrh1ws
Instance DB11 is running on node db11-cloud-12

[grid@db11-cloud-12 ~]$ srvctl start database -d db11_zrh1ws -o nomount

[grid@db11-cloud-12 ~]$ srvctl status database -d db11_zrh1ws

Instance DB11 is running on node db11-cloud-12

6. Restore OCI cloud database from Object Store

Restore and recovery of the database, the database has same name as the on-prem database. The datafile is migrated from file system to ASM. Required information for restore and recovery:

On-prem database DBID
Encryption password

Cloud Database – Login in RMAN and set Decryption Password set Source DBID

[opc@db11-cloud-12 ~]$ sudo su - oracle
Last login: Mon Nov 1 14:40:05 CET 2021

1 2	[opc@db11-cloud-12 ~]$ sudo su - oracle Last login: Mon Nov 1 14:40:05 CET 2021

[oracle@db11-cloud-12 ~]$ . oraenv
ORACLE_SID = [DB11] ?
The Oracle base has been set to /u01/app/oracle

[oracle@db11-cloud-12 ~]$ . oraenv

ORACLE_SID = [DB11] ?

The Oracle base has been set to /u01/app/oracle

[oracle@db11-cloud-12 ~]$ rman target /
RMAN> SET DECRYPTION IDENTIFIED BY '<my-onprem-encryption-password-here';
RMAN> SET DBID=1617630071;

[oracle@db11-cloud-12 ~]$ rman target /

RMAN> SET DECRYPTION IDENTIFIED BY '<my-onprem-encryption-password-here';

RMAN> SET DBID=1617630071;

Cloud Database – Restore Controlfile from Object Storage

Use the library path and the path to the configuration file (OPC_FILE) properly.

RMAN> RUN {
2> ALLOCATE CHANNEL t1 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';
3> RESTORE CONTROLFILE FROM AUTOBACKUP;
4> }

allocated channel: t1
channel t1: SID=176 device type=SBT_TAPE
channel t1: Oracle Database Backup Service Library VER=21.0.0.1

Starting restore at 01-NOV-21

channel t1: looking for AUTOBACKUP on day: 20211101
channel t1: AUTOBACKUP found: c-1617637023-20211101-04
channel t1: restoring control file from AUTOBACKUP c-1617637023-20211101-04
channel t1: control file restore from AUTOBACKUP complete
output file name=+RECO/db11_zrh1ws/controlfile/current.256.1087483283
Finished restore at 01-NOV-21
released channel: t1

RMAN> RUN {

2> ALLOCATE CHANNEL t1 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';

3> RESTORE CONTROLFILE FROM AUTOBACKUP;

4> }

allocated channel: t1

channel t1: SID=176 device type=SBT_TAPE

channel t1: Oracle Database Backup Service Library VER=21.0.0.1

Starting restore at 01-NOV-21

channel t1: looking for AUTOBACKUP on day: 20211101

channel t1: AUTOBACKUP found: c-1617637023-20211101-04

channel t1: restoring control file from AUTOBACKUP c-1617637023-20211101-04

channel t1: control file restore from AUTOBACKUP complete

output file name=+RECO/db11_zrh1ws/controlfile/current.256.1087483283

Finished restore at 01-NOV-21

released channel: t1

Cloud Database – Mount Instance

RMAN> ALTER DATABASE MOUNT;

1	RMAN> ALTER DATABASE MOUNT;

Cloud Database – Restore Instance

Allocate channel for maintenance first.

RMAN> ALLOCATE CHANNEL FOR MAINTENANCE DEVICE TYPE DISK;

allocated channel: ORA_MAINT_DISK_1
channel ORA_MAINT_DISK_1: SID=318 device type=DISK

RMAN> ALLOCATE CHANNEL FOR MAINTENANCE DEVICE TYPE DISK;

allocated channel: ORA_MAINT_DISK_1

channel ORA_MAINT_DISK_1: SID=318 device type=DISK

Start restore.

RMAN> RUN {
2> SET NEWNAME FOR DATABASE TO '+DATA';
3> ALLOCATE CHANNEL t1 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';
4> ALLOCATE CHANNEL t2 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';
5> RESTORE DATABASE;
6> SWITCH DATAFILE ALL;
7> }

executing command: SET NEWNAME

allocated channel: t1
channel t1: SID=177 device type=SBT_TAPE
channel t1: Oracle Database Backup Service Library VER=21.0.0.1

allocated channel: t2
channel t2: SID=13 device type=SBT_TAPE
channel t2: Oracle Database Backup Service Library VER=21.0.0.1

Starting restore at 01-NOV-21
Starting implicit crosscheck backup at 01-NOV-21
Crosschecked 2 objects
Finished implicit crosscheck backup at 01-NOV-21

Starting implicit crosscheck copy at 01-NOV-21
Finished implicit crosscheck copy at 01-NOV-21

searching for all files in the recovery area
cataloging files...
no files cataloged


channel t1: starting datafile backup set restore
channel t1: specifying datafile(s) to restore from backup set
channel t1: restoring datafile 00001 to +DATA
channel t1: restoring datafile 00002 to +DATA
channel t1: restoring datafile 00003 to +DATA
channel t1: restoring datafile 00004 to +DATA
channel t1: restoring datafile 00005 to +DATA
channel t1: restoring datafile 00006 to +DATA
channel t1: restoring datafile 00007 to +DATA
channel t1: restoring datafile 00008 to +DATA
channel t1: restoring datafile 00009 to +DATA
channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/inc0_DB11_2021-11-01_04-30-04_s569_p1

channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/inc0_DB11_2021-11-01_04-30-04_s569_p1 tag=TAG20211101T043005
channel t1: restored backup piece 1
channel t1: restore complete, elapsed time: 00:16:45
Finished restore at 01-NOV-21

datafile 1 switched to datafile copy
input datafile copy RECID=10 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/system.267.1087483371
datafile 2 switched to datafile copy
input datafile copy RECID=11 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/sysaux.268.1087483371
datafile 3 switched to datafile copy
input datafile copy RECID=12 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/undotbs1.261.1087483371
datafile 4 switched to datafile copy
input datafile copy RECID=13 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/users.262.1087483371
datafile 5 switched to datafile copy
input datafile copy RECID=14 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/hrdata.269.1087483371
datafile 6 switched to datafile copy
input datafile copy RECID=15 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/soedata.266.1087483371
datafile 7 switched to datafile copy
input datafile copy RECID=16 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/shdata.270.1087483443
datafile 8 switched to datafile copy
input datafile copy RECID=17 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/soedata.263.1087483371
datafile 9 switched to datafile copy
input datafile copy RECID=18 STAMP=1087484377 file name=+DATA/db11_zrh1ws/datafile/soedata.264.1087483371
released channel: t1
released channel: t2

RMAN> RUN {

2> SET NEWNAME FOR DATABASE TO '+DATA';

3> ALLOCATE CHANNEL t1 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';

4> ALLOCATE CHANNEL t2 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';

5> RESTORE DATABASE;

6> SWITCH DATAFILE ALL;

7> }

executing command: SET NEWNAME

allocated channel: t1

channel t1: SID=177 device type=SBT_TAPE

channel t1: Oracle Database Backup Service Library VER=21.0.0.1

allocated channel: t2

channel t2: SID=13 device type=SBT_TAPE

channel t2: Oracle Database Backup Service Library VER=21.0.0.1

Starting restore at 01-NOV-21

Starting implicit crosscheck backup at 01-NOV-21

Crosschecked 2 objects

Finished implicit crosscheck backup at 01-NOV-21

Starting implicit crosscheck copy at 01-NOV-21

Finished implicit crosscheck copy at 01-NOV-21

searching for all files in the recovery area

cataloging files...

no files cataloged

channel t1: starting datafile backup set restore

channel t1: specifying datafile(s) to restore from backup set

channel t1: restoring datafile 00001 to +DATA

channel t1: restoring datafile 00002 to +DATA

channel t1: restoring datafile 00003 to +DATA

channel t1: restoring datafile 00004 to +DATA

channel t1: restoring datafile 00005 to +DATA

channel t1: restoring datafile 00006 to +DATA

channel t1: restoring datafile 00007 to +DATA

channel t1: restoring datafile 00008 to +DATA

channel t1: restoring datafile 00009 to +DATA

channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/inc0_DB11_2021-11-01_04-30-04_s569_p1

channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/inc0_DB11_2021-11-01_04-30-04_s569_p1 tag=TAG20211101T043005

channel t1: restored backup piece 1

channel t1: restore complete, elapsed time: 00:16:45

Finished restore at 01-NOV-21

datafile 1 switched to datafile copy

input datafile copy RECID=10 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/system.267.1087483371

datafile 2 switched to datafile copy

input datafile copy RECID=11 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/sysaux.268.1087483371

datafile 3 switched to datafile copy

input datafile copy RECID=12 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/undotbs1.261.1087483371

datafile 4 switched to datafile copy

input datafile copy RECID=13 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/users.262.1087483371

datafile 5 switched to datafile copy

input datafile copy RECID=14 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/hrdata.269.1087483371

datafile 6 switched to datafile copy

input datafile copy RECID=15 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/soedata.266.1087483371

datafile 7 switched to datafile copy

input datafile copy RECID=16 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/shdata.270.1087483443

datafile 8 switched to datafile copy

input datafile copy RECID=17 STAMP=1087484376 file name=+DATA/db11_zrh1ws/datafile/soedata.263.1087483371

datafile 9 switched to datafile copy

input datafile copy RECID=18 STAMP=1087484377 file name=+DATA/db11_zrh1ws/datafile/soedata.264.1087483371

released channel: t1

released channel: t2

Recover database – ignore the last line of the incomplete recovery.

RMAN> RUN {
2> ALLOCATE CHANNEL t1 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';
3> RECOVER DATABASE;
4> }

allocated channel: t1
channel t1: SID=177 device type=SBT_TAPE
channel t1: Oracle Database Backup Service Library VER=21.0.0.1

Starting recover at 01-NOV-21

starting media recovery

channel t1: starting archived log restore to default destination
channel t1: restoring archived log
archived log thread=1 sequence=1009
channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_04-30-04_s570_p1
channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_04-30-04_s570_p1 tag=TAG20211101T044520
channel t1: restored backup piece 1
channel t1: restore complete, elapsed time: 00:00:03
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1009.259.1087484649 thread=1 sequence=1009
channel default: deleting archived log(s)
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1009.259.1087484649 RECID=964 STAMP=1087484650
channel t1: starting archived log restore to default destination
channel t1: restoring archived log
archived log thread=1 sequence=1010
channel t1: restoring archived log
archived log thread=1 sequence=1011
channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_06-00-03_s574_p1
channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_06-00-03_s574_p1 tag=TAG20211101T060005
channel t1: restored backup piece 1
channel t1: restore complete, elapsed time: 00:00:01
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1010.259.1087484653 thread=1 sequence=1010
channel default: deleting archived log(s)
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1010.259.1087484653 RECID=966 STAMP=1087484653
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1011.258.1087484653 thread=1 sequence=1011
channel default: deleting archived log(s)
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1011.258.1087484653 RECID=965 STAMP=1087484653
channel t1: starting archived log restore to default destination
channel t1: restoring archived log
archived log thread=1 sequence=1012
channel t1: restoring archived log
archived log thread=1 sequence=1013
channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_10-00-03_s578_p1
channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_10-00-03_s578_p1 tag=TAG20211101T100005
channel t1: restored backup piece 1
channel t1: restore complete, elapsed time: 00:00:01
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1012.258.1087484655 thread=1 sequence=1012
channel default: deleting archived log(s)
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1012.258.1087484655 RECID=968 STAMP=1087484654
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1013.259.1087484655 thread=1 sequence=1013
channel default: deleting archived log(s)
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1013.259.1087484655 RECID=967 STAMP=1087484654
channel t1: starting archived log restore to default destination
channel t1: restoring archived log
archived log thread=1 sequence=1014
channel t1: restoring archived log
archived log thread=1 sequence=1015
channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_14-00-03_s582_p1
channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_14-00-03_s582_p1 tag=TAG20211101T140005
channel t1: restored backup piece 1
channel t1: restore complete, elapsed time: 00:00:01
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1014.259.1087484657 thread=1 sequence=1014
channel default: deleting archived log(s)
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1014.259.1087484657 RECID=970 STAMP=1087484656
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1015.258.1087484657 thread=1 sequence=1015
channel default: deleting archived log(s)
archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1015.258.1087484657 RECID=969 STAMP=1087484656
unable to find archived log
archived log thread=1 sequence=1016
released channel: t1
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of recover command at 11/01/2021 15:04:18
RMAN-06054: media recovery requesting unknown archived log for thread 1 with sequence 1016 and starting SCN of 1782476

RMAN> RUN {

2> ALLOCATE CHANNEL t1 DEVICE TYPE sbt PARMS 'SBT_LIBRARY=/u01/app/oracle/oci/lib/libopc.so ENV=(OPC_PFILE=/u01/app/oracle/product/11.2.0.4/dbhome_1/dbs/opcDB11.ora)';

3> RECOVER DATABASE;

4> }

allocated channel: t1

channel t1: SID=177 device type=SBT_TAPE

channel t1: Oracle Database Backup Service Library VER=21.0.0.1

Starting recover at 01-NOV-21

starting media recovery

channel t1: starting archived log restore to default destination

channel t1: restoring archived log

archived log thread=1 sequence=1009

channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_04-30-04_s570_p1

channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_04-30-04_s570_p1 tag=TAG20211101T044520

channel t1: restored backup piece 1

channel t1: restore complete, elapsed time: 00:00:03

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1009.259.1087484649 thread=1 sequence=1009

channel default: deleting archived log(s)

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1009.259.1087484649 RECID=964 STAMP=1087484650

channel t1: starting archived log restore to default destination

channel t1: restoring archived log

archived log thread=1 sequence=1010

channel t1: restoring archived log

archived log thread=1 sequence=1011

channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_06-00-03_s574_p1

channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_06-00-03_s574_p1 tag=TAG20211101T060005

channel t1: restored backup piece 1

channel t1: restore complete, elapsed time: 00:00:01

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1010.259.1087484653 thread=1 sequence=1010

channel default: deleting archived log(s)

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1010.259.1087484653 RECID=966 STAMP=1087484653

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1011.258.1087484653 thread=1 sequence=1011

channel default: deleting archived log(s)

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1011.258.1087484653 RECID=965 STAMP=1087484653

channel t1: starting archived log restore to default destination

channel t1: restoring archived log

archived log thread=1 sequence=1012

channel t1: restoring archived log

archived log thread=1 sequence=1013

channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_10-00-03_s578_p1

channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_10-00-03_s578_p1 tag=TAG20211101T100005

channel t1: restored backup piece 1

channel t1: restore complete, elapsed time: 00:00:01

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1012.258.1087484655 thread=1 sequence=1012

channel default: deleting archived log(s)

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1012.258.1087484655 RECID=968 STAMP=1087484654

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1013.259.1087484655 thread=1 sequence=1013

channel default: deleting archived log(s)

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1013.259.1087484655 RECID=967 STAMP=1087484654

channel t1: starting archived log restore to default destination

channel t1: restoring archived log

archived log thread=1 sequence=1014

channel t1: restoring archived log

archived log thread=1 sequence=1015

channel t1: reading from backup piece /u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_14-00-03_s582_p1

channel t1: piece handle=/u01/app/oracle/admin/DB11/backup/arc_DB11_2021-11-01_14-00-03_s582_p1 tag=TAG20211101T140005

channel t1: restored backup piece 1

channel t1: restore complete, elapsed time: 00:00:01

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1014.259.1087484657 thread=1 sequence=1014

channel default: deleting archived log(s)

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1014.259.1087484657 RECID=970 STAMP=1087484656

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1015.258.1087484657 thread=1 sequence=1015

channel default: deleting archived log(s)

archived log file name=+RECO/db11_zrh1ws/archivelog/2021_11_01/thread_1_seq_1015.258.1087484657 RECID=969 STAMP=1087484656

unable to find archived log

archived log thread=1 sequence=1016

released channel: t1

RMAN-00571: ===========================================================

RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============

RMAN-00571: ===========================================================

RMAN-03002: failure of recover command at 11/01/2021 15:04:18

RMAN-06054: media recovery requesting unknown archived log for thread 1 with sequence 1016 and starting SCN of 1782476

Cloud Database – Open RESETLOGS

RMAN> ALTER DATABASE OPEN RESETLOGS;

database opened

RMAN> ALTER DATABASE OPEN RESETLOGS;

database opened

7. Encrypt Tablespace

Cloud Database – Verify Tablespaces

SQL> COL tablespace_name FORMAT a20
SQL> COL file_name FORMAT a70
SQL> SET LINES 300

SQL> SELECT tablespace_name, file_name
  2 FROM dba_data_files
  3 ORDER BY 1;

TABLESPACE_NAME FILE_NAME
-------------------- ----------------------------------------------------------------------
HRDATA               +DATA/db11_zrh1ws/datafile/hrdata.269.1087483371
SHDATA               +DATA/db11_zrh1ws/datafile/shdata.270.1087483443
SOEDATA              +DATA/db11_zrh1ws/datafile/soedata.264.1087483371
SOEDATA              +DATA/db11_zrh1ws/datafile/soedata.266.1087483371
SOEDATA              +DATA/db11_zrh1ws/datafile/soedata.263.1087483371
SYSAUX               +DATA/db11_zrh1ws/datafile/sysaux.268.1087483371
SYSTEM               +DATA/db11_zrh1ws/datafile/system.267.1087483371
UNDOTBS1             +DATA/db11_zrh1ws/datafile/undotbs1.261.1087483371
USERS                +DATA/db11_zrh1ws/datafile/users.262.1087483371

9 rows selected.

SQL> COL tablespace_name FORMAT a20

SQL> COL file_name FORMAT a70

SQL> SET LINES 300

SQL> SELECT tablespace_name, file_name

2 FROM dba_data_files

3 ORDER BY 1;

TABLESPACE_NAME FILE_NAME

-------------------- ----------------------------------------------------------------------

HRDATA +DATA/db11_zrh1ws/datafile/hrdata.269.1087483371

SHDATA +DATA/db11_zrh1ws/datafile/shdata.270.1087483443

SOEDATA +DATA/db11_zrh1ws/datafile/soedata.264.1087483371

SOEDATA +DATA/db11_zrh1ws/datafile/soedata.266.1087483371

SOEDATA +DATA/db11_zrh1ws/datafile/soedata.263.1087483371

SYSAUX +DATA/db11_zrh1ws/datafile/sysaux.268.1087483371

SYSTEM +DATA/db11_zrh1ws/datafile/system.267.1087483371

UNDOTBS1 +DATA/db11_zrh1ws/datafile/undotbs1.261.1087483371

USERS +DATA/db11_zrh1ws/datafile/users.262.1087483371

9 rows selected.

Cloud Database – Tablespace Encryption

We use the existing wallet and add a new TDE master key to the configuration. Show parameter for tablespace encryption.

SQL> show parameter encrypt_new_tablespaces

NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
encrypt_new_tablespaces string CLOUD_ONLY

SQL> show parameter encrypt_new_tablespaces

NAME TYPE VALUE

------------------------------------ ----------- ------------------------------

encrypt_new_tablespaces string CLOUD_ONLY

SQL> col WRL_TYPE format a10
SQL> col WRL_PARAMETER format a60
SQL> col STATUS format a10
SQL> set lines 300
SQL> SELECT * FROM v$encryption_wallet;

WRL_TYPE   WRL_PARAMETER                                                STATUS
---------- ------------------------------------------------------------ ----------
file       /opt/oracle/dcs/commonstore/wallets/tde/$ORACLE_UNQNAME      OPEN

SQL> col WRL_TYPE format a10

SQL> col WRL_PARAMETER format a60

SQL> col STATUS format a10

SQL> set lines 300

SQL> SELECT * FROM v$encryption_wallet;

WRL_TYPE WRL_PARAMETER STATUS

---------- ------------------------------------------------------------ ----------

file /opt/oracle/dcs/commonstore/wallets/tde/$ORACLE_UNQNAME OPEN

Verify existing actual encryption situation, no tablespaces are encrypted.

SQL> select TABLESPACE_NAME,ENCRYPTED from dba_tablespaces;

TABLESPACE_NAME                ENC
------------------------------ ---
SYSTEM                         NO
SYSAUX                         NO
UNDOTBS1                       NO
TEMP                           NO
USERS                          NO
HRDATA                         NO
SOEDATA                        NO
SHDATA                         NO

8 rows selected.

SQL> select TABLESPACE_NAME,ENCRYPTED from dba_tablespaces;

TABLESPACE_NAME ENC

------------------------------ ---

SYSTEM NO

SYSAUX NO

UNDOTBS1 NO

TEMP NO

USERS NO

HRDATA NO

SOEDATA NO

SHDATA NO

8 rows selected.

Take user tablespaces offline – a small syntax provider script.

SQL> SELECT 'ALTER TABLESPACE '||tablespace_name|| ' offline;'
  2> FROM dba_tablespaces
  3> WHERE tablespace_name NOT IN ('SYSTEM','SYSAUX','TEMP','UNDOTBS1');

'ALTERTABLESPACE'||TABLESPACE_NAME||'OFFLINE;'
--------------------------------------------------------
ALTER TABLESPACE USERS offline;
ALTER TABLESPACE HRDATA offline;
ALTER TABLESPACE SOEDATA offline;
ALTER TABLESPACE SHDATA offline;

SQL> SELECT 'ALTER TABLESPACE '||tablespace_name|| ' offline;'

2> FROM dba_tablespaces

3> WHERE tablespace_name NOT IN ('SYSTEM','SYSAUX','TEMP','UNDOTBS1');

'ALTERTABLESPACE'||TABLESPACE_NAME||'OFFLINE;'

--------------------------------------------------------

ALTER TABLESPACE USERS offline;

ALTER TABLESPACE HRDATA offline;

ALTER TABLESPACE SOEDATA offline;

ALTER TABLESPACE SHDATA offline;

As SYS AS SYSDBA, set new Master Key

SQL> ALTER SYSTEM SET ENCRYPTION KEY IDENTIFIED BY "<your_TDE_Master_Key_here>";

1	SQL> ALTER SYSTEM SET ENCRYPTION KEY IDENTIFIED BY "<your_TDE_Master_Key_here>";

Encrypt tablespaces – a small syntax provider script.

SQL> SELECT 'ALTER DATABASE DATAFILE '''|| file_name||''' encrypt;'
  2> FROM dba_data_files
  3> WHERE tablespace_name NOT IN ('SYSTEM','SYSAUX','TEMP','UNDOTBS1');

'ALTERDATABASEDATAFILE'''||FILE_NAME||'''ENCRYPT;'
--------------------------------------------------------------------------------------
ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/users.262.1087483371' encrypt;
ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/hrdata.269.1087483371' encrypt;
ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/soedata.266.1087483371' encrypt;
ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/shdata.270.1087483443' encrypt;
ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/soedata.263.1087483371' encrypt;
ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/soedata.264.1087483371' encrypt;

SQL> SELECT 'ALTER DATABASE DATAFILE '''|| file_name||''' encrypt;'

2> FROM dba_data_files

3> WHERE tablespace_name NOT IN ('SYSTEM','SYSAUX','TEMP','UNDOTBS1');

'ALTERDATABASEDATAFILE'''||FILE_NAME||'''ENCRYPT;'

--------------------------------------------------------------------------------------

ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/users.262.1087483371' encrypt;

ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/hrdata.269.1087483371' encrypt;

ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/soedata.266.1087483371' encrypt;

ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/shdata.270.1087483443' encrypt;

ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/soedata.263.1087483371' encrypt;

ALTER DATABASE DATAFILE '+DATA/db11_zrh1ws/datafile/soedata.264.1087483371' encrypt;

Take encrypted tablespaces online, the encryption starts and the taking online action needs some time (depends on CPU and I/O).

SQL> SELECT 'ALTER TABLESPACE '||tablespace_name|| ' online;'
  2> FROM dba_tablespaces
  3> WHERE tablespace_name NOT IN ('SYSTEM','SYSAUX','TEMP','UNDOTBS1');

'ALTERTABLESPACE'||TABLESPACE_NAME||'ONLINE;'
--------------------------------------------------------
ALTER TABLESPACE USERS online;
ALTER TABLESPACE HRDATA online;
ALTER TABLESPACE SOEDATA online;
ALTER TABLESPACE SHDATA online;

SQL> SELECT 'ALTER TABLESPACE '||tablespace_name|| ' online;'

2> FROM dba_tablespaces

3> WHERE tablespace_name NOT IN ('SYSTEM','SYSAUX','TEMP','UNDOTBS1');

'ALTERTABLESPACE'||TABLESPACE_NAME||'ONLINE;'

--------------------------------------------------------

ALTER TABLESPACE USERS online;

ALTER TABLESPACE HRDATA online;

ALTER TABLESPACE SOEDATA online;

ALTER TABLESPACE SHDATA online;

A few minutes later, the user tablespaces are shown as encrypted.

SQL> select TABLESPACE_NAME,ENCRYPTED from dba_tablespaces;

TABLESPACE_NAME                ENC
------------------------------ ---
SYSTEM                         NO
SYSAUX                         NO
UNDOTBS1                       NO
TEMP                           NO
USERS                          YES
HRDATA                         YES
SOEDATA                        YES
SHDATA                         YES

8 rows selected.

SQL> select TABLESPACE_NAME,ENCRYPTED from dba_tablespaces;

TABLESPACE_NAME ENC

------------------------------ ---

SYSTEM NO

SYSAUX NO

UNDOTBS1 NO

TEMP NO

USERS YES

HRDATA YES

SOEDATA YES

SHDATA YES

8 rows selected.

Verify encrypted tablespaces by DBVerify – as you can see here, Total Pages Encrypted is shown.

[oracle@db11-cloud-12 trace]$ dbv file=+DATA/db11_zrh1ws/datafile/soedata.263.1087483371 USERID=system/<your_SYSTEM_password_here>

DBVERIFY: Release 11.2.0.4.0 - Production on Mon Nov 1 15:20:43 2021

Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.

DBVERIFY - Verification starting : FILE = +DATA/db11_zrh1ws/datafile/soedata.263.1087483371

DBVERIFY - Verification complete

Total Pages Examined : 1600000
Total Pages Processed (Data) : 0
Total Pages Failing (Data) : 0
Total Pages Processed (Index): 0
Total Pages Failing (Index): 0
Total Pages Processed (Other): 84893
Total Pages Processed (Seg) : 0
Total Pages Failing (Seg) : 0
Total Pages Empty : 6273
Total Pages Marked Corrupt : 0
Total Pages Influx : 0
Total Pages Encrypted : 1508834
Highest block SCN : 0 (0.0)

[oracle@db11-cloud-12 trace]$ dbv file=+DATA/db11_zrh1ws/datafile/soedata.263.1087483371 USERID=system/<your_SYSTEM_password_here>

DBVERIFY: Release 11.2.0.4.0 - Production on Mon Nov 1 15:20:43 2021

DBVERIFY - Verification starting : FILE = +DATA/db11_zrh1ws/datafile/soedata.263.1087483371

DBVERIFY - Verification complete

Total Pages Examined : 1600000

Total Pages Processed (Data) : 0

Total Pages Failing (Data) : 0

Total Pages Processed (Index): 0

Total Pages Failing (Index): 0

Total Pages Processed (Other): 84893

Total Pages Processed (Seg) : 0

Total Pages Failing (Seg) : 0

Total Pages Empty : 6273

Total Pages Marked Corrupt : 0

Total Pages Influx : 0

Total Pages Encrypted : 1508834

Highest block SCN : 0 (0.0)

Summary and what’s next

Migration of an on-prem database to Oracle Cloud Infrastructire by RMAN and Object Storage is a very nice method to bring not only older databases into the Oracle Cloud Infrastructure. Once there, you can leverage of OCI features like Data Safe, monitoring, backup to Object Storage and many more.

#ilikeit

11g, DBaaS, Oracle Cloud Infrastructure, Oracle Linux, Oracle RDBMS

Never stop Learning – why I love Oracle LiveLabs

Author: Martin Berger 8. October 2021

Since over one and a half year, this week I was back in an onsite training, live people, live teaching. With a motivated junior DBA class, we started with all about Oracle architecture based on our Trivadis training O-AI – Oracle Architecture and Internals. The training is a mix between slides, demos and labs. Therefore during the course we run the training environments in Oracle Cloud Infrastructure, build by Terraform (Credits to Stefan Oehrli from oradba.ch which has ramped up the whole stuff). After the course at the end of the month, the environments will be cleaned up. And what’s next?

Training Environments

There are a lot of possibilities to get a deeper knowledge of all this Oracle stuff like processes, data encryption, multitenancy, datapump and so on:

Virtual Box Machines – for example the pre-defined HOL VM from Mike Dietrich
Local virtual machines
Test environments in the company
Oracle LiveSQL
Docker Images from Oracle
… and so on…

But my actual favorite is Oracle LiveLabs!

Oracle LiveLabs

This platform is not only for DBAs, it has a lot of workshops for Application Developers, Data Scientists and DevOps Engineers too. There are different workshop types available:

get your free Oracle Cloud Infrastructure training environment for free during a time period like Oracle Database 19c New Features – run on LiveLabs
workshops which are running in a free tenancy
workshops what you can do in your own paid tenancy

At the moment there are 21 workshops where you get a live environment with all components you need virtual machines or database in Oracle Cloud Infrastructure like Oracle Multitenant Fundamentals, Database 19c – Automatic Indexing, 21c New Features on Autonomous Database and many more. All workshops are very well described, from the access to the initial setup and finally for the workshop himself too.

In this case I have decided to start the Oracle Multitenant lab to gather more information how PDB Snapshot Copy works.

1st – Search your training in the available workshops and press Launch

2nd – Define where the Workshop should run

In this case, I want to reserve an environment. This is not possible for all workshops, you can see that in the workshop details if it’s possible to the an Oracle Cloud Infrastructure setup.

3rd – Define the Start Date and propose your SSH Public Key

With the key, you can get access to the training servers by SSH. In this case I want to start the workshop immediately. Otherwise define a start and end date. If you don’t want to start now, you will get a confirmation that the workshop is reserved and an email at the day where the workshop starts with the credential information.

4rd – View my Reservation

After some minutes, the status for the workshop is updated. As you can see here, in about three minutes from now, the environment should be ready. You will receive a confirmation mail.

5th – Launch Workshop

When the workshop is ready, the workshop can be launched.

6th – Workshop Details

All information you need is in the details like:

User name
Initial password for OCI
Compartment
Instance public IP

Here you have also the chance to extend your workshop reservation time. Follow the Get Started instructions to the bottom and push the button to move on the introduction. Step by step you are guide through the login and setup process. All labs contain a manual how to connect and to do the initial setup like starting listeners or get scripts from the OCI Object Storage.

There are the connection options how you can interact with the LiveLab:

Connect using Cloud Shell
Connect using MAC or a Windows CYGWIN Emulator
Connect using Putty

Example code for the multitenancy lab preparation:

Summary

Oracle LiveLabs is another great opportunity to learn and train new stuff. All you have to take care now is to follow the workshop instructions and take care about the limited time. Enjoy it, learn new stuff and have fun! Oracle LiveLabs are easy to join, easy to set up and well described. This is why I love it 🙂

19c, Autonomous Database, DBaaS, Oracle Cloud Infrastructure, Oracle RDBMS, Testing

Oracle Cloud Infrastructure – A short Blog Post about a secure and small Development Setup

Author: Martin Berger 14. January 2021

For an internal project I had the pleasure to setup a new Oracle Cloud Infrastructure environment for an APEX development team. Here is a short overview about the setup.

Requirements

VPN Access from everywhere – 2 people are working maximal at same time on the environment
Oracle Standard Edition 2 – no license available in project
Small monitoring to verify server stats
Instances can be started and stopped from the developers to save costs for example over night, weekend, holiday etc.

Architecture Diagram

Resource	Network	Usage	Remarks
Open VPN Access Server	Public Subnet	VPN client access and traffic routing	OCI Cloud Marketplace Image – OpenVPN Access Server (2 FREE VPN Connections) – OpenVPN Inc. – Oracle Cloud Marketplace
Management Server	Private Subnet	OCI-CLI, Monitoring	Application server and database node start/stop with OCI-CLI, Grafana and Prometheus for monitoring
Application Server	Private Subnet	Tomcat ORDS, APEX	–
Database System	Private Subnet	–	OCI Database Standard Edition 2, Backup to Object Store enabled

Network Components

Regional private and public subnet
Security lists and network security groups
Private and public routing table
NAT gateway for regional private subnet

Monitoring

Grafana and Prometheus, running on the management server. The free shape VM.Standard.E2.1.Micro fits perfect for this small setup! The Prometheus node exporter runs on the database and the application server. I used this Grafana dashboard here: Prometheus Node Exporter Full dashboard for Grafana | Grafana Labs

Next Steps

Adding Influx DB for persistence
Adding the Oracle database to Grafana monitoring
Optimizing shape size for the database server according usage

Other Ideas

Create a blueprint for internal developer environments
Automate the setup with Terraform and Ansible

Summary

Setting up this infrastructure in Oracle Cloud Infrastructure was fun. All developer requirements are fulfilled. Started with the Network and OpenVPN configuration – I really like their Marketplace instance – and the moved on to application and database server, step-by-step. There are many other ideas what we can do more based on this setup, the work will not run out. #ilike

Oracle Cloud Infrastructure, Oracle Tools, Security, Testing, TrivadisContent

Oracle Cloud Infrastructure Data Safe – How to burn down 201.44 Swiss Francs in 30 Seconds…

Author: Martin Berger 11. January 2021

Is Data Safe really for free?

In the last autumn, the new Oracle Cloud Infrastructure feature called Data Safe was released. For sure, new features has to be tested. I have tested the Data Safe feature too and added a cloud database to Data Safe. But in my enthusiasm about this cool feature – or maybe it was just too late in the evening – I did a mistake by adding the database target. Four days later, I recognized that Data Safe is charged in my account. Mmm, but should it not be for free? First reaction: I raised an SR and described the case. The nice guy from My Oracle Support realized the situation quickly:

Dear Mister Berger, you have used the wrong target type when adding the Oracle Cloud Infrastructure database as a new Data Safe target.

From the Service Request:

B91632 – Oracle Cloud Infrastructure – Data Safe for Database Cloud Service – Each (Includes 1 million audit records per target per month) – Free
B91631 – Oracle Cloud Infrastructure – Data Safe for Database Cloud Service – Audit Record Collection Over 1 Million Records (over 1 million audit records per target per month) – 0.0800 / 10,000 Audit Records Per Target Per Month
B92733 – Oracle Cloud Infrastructure – Data Safe for On-Premises Databases – Target Database Per Month – 200.00 Target Database Per Month + Includes 1 million audit records per target per month (pre-requisite under B91632)

Indeed, indeed. According My Oracle Support I have used the wrong target type. Instead Oracle Cloud Database, I used Oracle Database on Compute. And did not realized, the mistake and ignored the text below to the dropdown box. Shame on me 😉 – here is the small, but important difference:

So far so good, the mistake was recognized. I deleted the target and added it from scratch with the correct target type. But this didn’t help, the charging went on.

Oracle Cloud Infrastructure Price List

Adding an other target type than Oracle Cloud Database is charged on monthly fee base as described here: Cloud Price List | Oracle

Cost and Usage Report

In the detailed cost and usage report, the target is marked as deleted (suffix DELETED + deletion date), and charged.

All you can do is getting angry about that mistake and wait. After a month, the money was burned down, and there were no more Oracle Cloud Infrastructure Data Safe costs charged. As you can see, there are 201.44 CHF charged for a month.

I don’t know what Oracle has for a currency converter, but actual 200 USD are less that 180 CHF 😉

Lessons learned

Pity about the beautiful money – and for my next test run: RTFM.

Oracle Cloud Infrastructure, Oracle Tools, Security, TrivadisContent

Oracle OCI Data Transfer Service – A journey from Kestenholz/Jurasüdfuss/Switzerland to Frankfurt and back

Author: Martin Berger 24. November 2020

The Oracle Data Transfer service is a offline data transfer method to migrate data to the Oracle Cloud Infrastructure. A transfer service is useful, when your network bandwidth and connection is not sufficient to upload your migration data in a meaningful time. Oracle offers two methods: The disk-based data transfer and the appliance-based data transfer. The service is no only one-way, data can also be exported in an Oracle Cloud Infrastructure data center and shipped to your data center.

According one of my Company Trivadis’ cultural value called curiosity, I was wondering how this service works. This is the story of a tiny USB Hard Disk Drive full of data, which was going on a long journey from Kestenholz / Jurasüdfuss / Solothurn / Switzerland to the Oracle Infrastructure data center in Frankfurt and back.

Setup

The OCI Data Transfer utility is Linux based, the USB 3.0 HDD is attached to a VMware Virtual machine where Oracle Linux is running
The virtual machine has access to the Internet
Data is available – for this example I used some open data from Swiss government (opendata.swiss)

Data Transfer Service Regions

Actually data transfer is available in Frankfurt, Ashburn, Phoenix, London and Osaka. From Switzerland, Frankfurt is the nearest location.

How is your data coming into the Oracle Cloud

Enable Data Transfer Service – Data Transfer
Prepare an Object Storage bucket
Create a Transfer Job
Attach a HDD to a Linux based host, use the Data Transfer Utility to create and encrypt the device
Copy data to the HDD
Create and upload the disk manifest
Lock the disk
Attach the Disk to the transfer label and create the package
Create a transfer package
Shipping and update shipping information
Tracking
Data Verification
Object Storage Replication Policy (optional)
Finally…

Note: Most of the jobs above can be done by the OCI CLI on command line and are very well described in the Oracle doumentation.

1. Enable Data Transfer Service – Entitlement

Before you can use this service, the Data Transfer service has to be enabled in general. Therefore you have to request it. The OCI tenant administrator gets a document, what he has to sign in a digital way. It contains for example a description how to bring data to OCI, and if you order an appliance that there will be a 45day maximum limit where the appliance has to be returned to Oracle. And a few days later, the service is ready to use. Basically now you have the permissions, to order a Data Transfer Appliance, but in this test I used the Disk Service.

2. Prepare an Object Storage Bucket

In the Frankfurt region, I created a new Object Storage bucket called data_transfer_usb. This is the bucket where the shipped data will be transferred in.

3. Create a Transfer Job

In Object Storage – Data Transfer Import, we create a new transfer job. It contains the upload bucket from above and as method the transfer device type is disk. For furtehr processing, we need the OCID of the job. As you can see, actually there is no transfer disk attached.

4. Attach a HDD to a Linux based host, use the Data Transfer Utility to create and encrypt the Device

Prerequisites for the Data Transfer Utility according the documentation:

An OCI Account which have the IAM permissions for Data Transfer
A Linux machine with Oracle Linux 6 or greater, Ubuntu 14.04 or greater, SUSE 11 or greater
Java 1.8 or 1.11
hdparm 9.0 or later
Cryptsetup 1.2.0 or later

Package Installation for my Oracle Linux 7 Machine

# yum install java-1.8.0-openjdk-devel
# yum install hdparm
# yum install cryptsetup

# yum install java-1.8.0-openjdk-devel

# yum install hdparm

# yum install cryptsetup

Download and Installation of the Data Transfer Utility

The actual link to the file is in the online documentation.

# wget https://docs.cloud.oracle.com/tools/dts-rpm/3.0.2461/dts-3.0.2461.x86_64.rpm
# yum localinstall /tmp/dts-3.0.2461.x86_64.rpm

1 2	# wget https://docs.cloud.oracle.com/tools/dts-rpm/3.0.2461/dts-3.0.2461.x86_64.rpm # yum localinstall /tmp/dts-3.0.2461.x86_64.rpm

Test

# dts --version
3.0.2461 ( DEV_NO_HASH )

1 2	# dts --version 3.0.2461 ( DEV_NO_HASH )

Configure IAM Credentials for Data Transfer Actions

The configuration is according configuring the Oracle Cloud Infrastructure CLI with user, fingerprint, key_file, tenancy and region. Example configuration file:

[DEFAULT]
user=ocid1.user.oc1..aaaaaaaadlv5vwm3zfdnyanosmdjm7cyjzdhmgawre12345671234567
fingerprint=6a:ce:8e:a7:4a:a1:70:ad:4e:d7:e6:8f:d1:23:45:g6
key_file=/root/.oci/oci_api_key.pem
tenancy=ocid1.tenancy.oc1..aaaaaaaaxuk4je4t3aorovuzmwyeaq5sftqv3nkyz64s12345671234567
region=eu-frankfurt-1

[DEFAULT]

user=ocid1.user.oc1..aaaaaaaadlv5vwm3zfdnyanosmdjm7cyjzdhmgawre12345671234567

fingerprint=6a:ce:8e:a7:4a:a1:70:ad:4e:d7:e6:8f:d1:23:45:g6

key_file=/root/.oci/oci_api_key.pem

tenancy=ocid1.tenancy.oc1..aaaaaaaaxuk4je4t3aorovuzmwyeaq5sftqv3nkyz64s12345671234567

region=eu-frankfurt-1

Verify Credentials

# dts job verify-upload-user-credentials --bucket data_transfer_usb
created object BulkDataTransferTestObject in bucket data_transfer_usb
overwrote object BulkDataTransferTestObject in bucket data_transfer_usb
inspected object BulkDataTransferTestObject in bucket data_transfer_usb
read object BulkDataTransferTestObject in bucket data_transfer_usb

# dts job verify-upload-user-credentials --bucket data_transfer_usb

created object BulkDataTransferTestObject in bucket data_transfer_usb

overwrote object BulkDataTransferTestObject in bucket data_transfer_usb

inspected object BulkDataTransferTestObject in bucket data_transfer_usb

read object BulkDataTransferTestObject in bucket data_transfer_usb

Show Data Transfer Job Details – Status is PREPARED

Here you can see the shipping address from the Oracle Infrastructure data center frankfurk and the label. Both information are used later in process.

# dts job show --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekvpmgdnnobcgrdb4awa7c5q
Transfer Job :
ID : ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekvpmgdnnobcgrdb4awa7c5q
CompartmentId : ocid1.compartment.oc1..aaaaaaaat5uo2xh77edws4huwvqorengp7x4xdv6x3giw3vryk36vyydwsdq
UploadBucket : data_transfer_usb
Name : data_transfer_usb_job_01
Label : J5Y0R5KAS
CreationDate : 2020/10/27 12:53:02 CET
Status : PREPARING
freeformTags : *** none ***
definedTags :
Oracle-Tags :
CreatedBy : oracleidentitycloudservice/martin.berger@trivadis.com
CreatedOn : 2020-10-27T11:53:02.320Z
Packages :
[1] :
Label : PDQ0QMLNT
TransferSiteShippingAddress : Telehouse c/o Oracle Data Transfer Service; Christos Panoudis; Phone: +49152 22882673 Job:J5Y0R5KAS Package:PDQ0QMLNT ; Kleyerstraße 75-87; 60326 Frankfurt am Main; Germany
DeliveryVendor : DHL
DeliveryTrackingNumber : *** none ***
ReturnDeliveryTrackingNumber : *** none ***
Status : PREPARING
Devices : [*** none ***]
UnattachedDevices : [*** none ***]
Appliances : [*** none ***]

# dts job show --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekvpmgdnnobcgrdb4awa7c5q

Transfer Job :

ID : ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekvpmgdnnobcgrdb4awa7c5q

CompartmentId : ocid1.compartment.oc1..aaaaaaaat5uo2xh77edws4huwvqorengp7x4xdv6x3giw3vryk36vyydwsdq

UploadBucket : data_transfer_usb

Name : data_transfer_usb_job_01

Label : J5Y0R5KAS

CreationDate : 2020/10/27 12:53:02 CET

Status : PREPARING

freeformTags : *** none ***

definedTags :

Oracle-Tags :

CreatedBy : oracleidentitycloudservice/martin.berger@trivadis.com

CreatedOn : 2020-10-27T11:53:02.320Z

Packages :

[1] :

Label : PDQ0QMLNT

TransferSiteShippingAddress : Telehouse c/o Oracle Data Transfer Service; Christos Panoudis; Phone: +49152 22882673 Job:J5Y0R5KAS Package:PDQ0QMLNT ; Kleyerstraße 75-87; 60326 Frankfurt am Main; Germany

DeliveryVendor : DHL

DeliveryTrackingNumber : *** none ***

ReturnDeliveryTrackingNumber : *** none ***

Status : PREPARING

Devices : [*** none ***]

UnattachedDevices : [*** none ***]

Appliances : [*** none ***]

Prepare USB Hard Disk Drive

The disk is attached as /dev/sdb – it is a Western Digital drive. Important: The disk needs no partition.

# fdisk -l /dev/sdb
Disk /dev/sdb: 931.5 GiB, 1000170586112 bytes, 1953458176 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xe7ec0c10

Device Boot Start End Sectors Size Id Type
/dev/sdb1 2048 1953458175 1953456128 931.5G 7 HPFS/NTFS/exFAT

# hdparm -I /dev/sdb | grep Model
Model Number: WDC WD10JMVW-11S5XS0

# fdisk -l /dev/sdb

Disk /dev/sdb: 931.5 GiB, 1000170586112 bytes, 1953458176 sectors

Units: sectors of 1 * 512 = 512 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disklabel type: dos

Disk identifier: 0xe7ec0c10

Device Boot Start End Sectors Size Id Type

/dev/sdb1 2048 1953458175 1953456128 931.5G 7 HPFS/NTFS/exFAT

# hdparm -I /dev/sdb | grep Model

Model Number: WDC WD10JMVW-11S5XS0

Create Transfer Disk for Data Copy

This command will setup the disk and mount it immediately. As additional information we need the disk label for further processing.

# dts disk create --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --block-device /dev/sdb

Will prepare /dev/sdb
serial number WD-WX61E82FY633 as an encrypted block device.
=> Set up disk for encryption using cryptsetup.
=> Create file system.
=> Mount file system.

Continue?? [y/n]y

---> IMPORTANT: RECORD THE ENCRYPTION PASSPHRASE: [m, o, 3, 4, +, j, w, I, 3, +, s, M, =] <---


The passphrase cannot be retrieved again. It will be used to encrypt this disk
and normally will not be needed again. However, if the system is restarted before
all files are copied to the filesystem and the disk is then finalized through this
CLI, you will need to provide the passphrase.

Continue?? [y/n]y

The disk label is DAMOED7GH
DO NOT INTERRUPT THIS COMMAND WHILE THE DISK IS BEING PREPARED.
This can take several minutes ...

initialized device for encryption
set up device for encryption
creating ext4 filesystem on /dev/mapper/WD-WX61E82FY633 ...
Found a atari partition table in /dev/mapper/WD-WX61E82FY633
created filesystem

Successfully prepared the disk.
You can now copy files to the file system.
After all files are copied, run this command to create the manifest:

dts disk manifest --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH [--object-name-prefix <object_name_prefix>]

Transfer Disk :
Label : DAMOED7GH
SerialNumber : WD-WX61E82FY633
Status : PREPARING
EncryptionPassphrase : mo34+jwI3+sUaL/NORhXOKQU9k12345671234567

# dts disk create --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --block-device /dev/sdb

Will prepare /dev/sdb

serial number WD-WX61E82FY633 as an encrypted block device.

=> Set up disk for encryption using cryptsetup.

=> Create file system.

=> Mount file system.

Continue?? [y/n]y

---> IMPORTANT: RECORD THE ENCRYPTION PASSPHRASE: [m, o, 3, 4, +, j, w, I, 3, +, s, M, =] <---

The passphrase cannot be retrieved again. It will be used to encrypt this disk

and normally will not be needed again. However, if the system is restarted before

all files are copied to the filesystem and the disk is then finalized through this

CLI, you will need to provide the passphrase.

Continue?? [y/n]y

The disk label is DAMOED7GH

DO NOT INTERRUPT THIS COMMAND WHILE THE DISK IS BEING PREPARED.

This can take several minutes ...

initialized device for encryption

set up device for encryption

creating ext4 filesystem on /dev/mapper/WD-WX61E82FY633 ...

Found a atari partition table in /dev/mapper/WD-WX61E82FY633

created filesystem

Successfully prepared the disk.

You can now copy files to the file system.

After all files are copied, run this command to create the manifest:

dts disk manifest --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH [--object-name-prefix <object_name_prefix>]

Transfer Disk :

Label : DAMOED7GH

SerialNumber : WD-WX61E82FY633

Status : PREPARING

EncryptionPassphrase : mo34+jwI3+sUaL/NORhXOKQU9k12345671234567

Mount point is /mnt/orcdts_DAMOED7GH.

# df -TH /mnt/orcdts_DAMOED7GH
Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/WD-WX61E82FY633 ext4 984G 80M 934G 1% /mnt/orcdts_DAMOED7GH

# df -TH /mnt/orcdts_DAMOED7GH

Filesystem Type Size Used Avail Use% Mounted on

/dev/mapper/WD-WX61E82FY633 ext4 984G 80M 934G 1% /mnt/orcdts_DAMOED7GH

The Transfer Disk status has changed to PREPARING and the disk serial number is registered now.

5. Copy Data to HDD

For the test run I have copied some Open Data stuff, an Oracle Backup and Oracle Data Pump export files to the disk.

# ll /mnt/orcdts_DAMOED7GH
total 1540788
-rw-r--r--. 1 root root 13816663 Oct 28 11:07 basel-opendata.tgz
-rw-r--r--. 1 root root 132009 Oct 28 11:07 bernmobil-opendata.tgz
-rw-r--r--. 1 root root 28493853 Oct 28 11:07 bundesverwaltung-opendata.tgz
-rw-r--r--. 1 root root 307998059 Oct 28 11:07 expdphr-28-10-20-01.dmp.tgz
-rw-r--r--. 1 root root 307998059 Oct 28 11:07 expdphr-28-10-20-02.dmp.tgz
drwx------. 2 root root 16384 Oct 28 11:03 lost+found
-rw-r--r--. 1 root root 695625592 Oct 28 11:08 RMAN_CDB118_28102020.tgz
-rw-r--r--. 1 root root 223666017 Oct 28 11:08 sbb-opendata.tgz

# ll /mnt/orcdts_DAMOED7GH

total 1540788

-rw-r--r--. 1 root root 13816663 Oct 28 11:07 basel-opendata.tgz

-rw-r--r--. 1 root root 132009 Oct 28 11:07 bernmobil-opendata.tgz

-rw-r--r--. 1 root root 28493853 Oct 28 11:07 bundesverwaltung-opendata.tgz

-rw-r--r--. 1 root root 307998059 Oct 28 11:07 expdphr-28-10-20-01.dmp.tgz

-rw-r--r--. 1 root root 307998059 Oct 28 11:07 expdphr-28-10-20-02.dmp.tgz

drwx------. 2 root root 16384 Oct 28 11:03 lost+found

-rw-r--r--. 1 root root 695625592 Oct 28 11:08 RMAN_CDB118_28102020.tgz

-rw-r--r--. 1 root root 223666017 Oct 28 11:08 sbb-opendata.tgz

6. Generate Manifest File

It generates a local file which contains a list of the files and her MD5 checksums like an inventory file. Here the disk label is required.

# dts disk manifest --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH
Walking the filesystem to gather stats and to check for errors
Reading all checkpoint data. This might take a while depending on checkpoint log size.
2020/10/28 11:09:18 Manifest generation started

Files processed : 2 / 8
Bytes processed : 41.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 103.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 164.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 228.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 284.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 353.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 412.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 476.15 MB / 1.47 GB

Files processed : 2 / 8
Bytes processed : 545.15 MB / 1.47 GB

Files processed : 3 / 8
Bytes processed : 616.88 MB / 1.47 GB

Files processed : 4 / 8
Bytes processed : 881.06 MB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 950.54 MB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1007.54 MB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1.04 GB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1.11 GB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1.18 GB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1.25 GB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1.31 GB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1.37 GB / 1.47 GB

Files processed : 6 / 8
Bytes processed : 1.41 GB / 1.47 GB

Files processed : 8 / 8
Bytes processed : 1.47 GB / 1.47 GB

# dts disk manifest --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH

Walking the filesystem to gather stats and to check for errors

Reading all checkpoint data. This might take a while depending on checkpoint log size.

2020/10/28 11:09:18 Manifest generation started

Files processed : 2 / 8

Bytes processed : 41.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 103.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 164.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 228.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 284.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 353.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 412.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 476.15 MB / 1.47 GB

Files processed : 2 / 8

Bytes processed : 545.15 MB / 1.47 GB

Files processed : 3 / 8

Bytes processed : 616.88 MB / 1.47 GB

Files processed : 4 / 8

Bytes processed : 881.06 MB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 950.54 MB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1007.54 MB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1.04 GB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1.11 GB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1.18 GB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1.25 GB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1.31 GB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1.37 GB / 1.47 GB

Files processed : 6 / 8

Bytes processed : 1.41 GB / 1.47 GB

Files processed : 8 / 8

Bytes processed : 1.47 GB / 1.47 GB

The file:

# cat /mnt/orcdts_DAMOED7GH/.bulk_data_transfer/metadata/manifest

{"path":"logFile.log","md5":"PZdMVbAydkbIo3JuJW5HKQ==","lastModifiedTime":1603879758896,"size":26710}
{"path":"bernmobil-opendata.tgz","md5":"J6VvwZemr5ayF+hZmEMvUQ==","lastModifiedTime":1603879648205,"size":132009}
{"path":"expdphr-28-10-20-02.dmp.tgz","md5":"tgtoAyh79EaAHnG2cMhJ4g==","lastModifiedTime":1603879668772,"size":307998059}
{"path":"basel-opendata.tgz","md5":"rRKvfnfw3kjRgp+yyJd9eg==","lastModifiedTime":1603879648180,"size":13816663}
{"path":"sbb-opendata.tgz","md5":"iggsOeCuvpE+zDlwoYmXcA==","lastModifiedTime":1603879699757,"size":223666017}
{"path":"bundesverwaltung-opendata.tgz","md5":"Pbs8W5rNpqs+x48bb/wVQw==","lastModifiedTime":1603879649038,"size":28493853}
{"path":"RMAN_CDB118_28102020.tgz","md5":"6ivSfbVKHceQ6FMy2xVSNA==","lastModifiedTime":1603879692329,"size":695625592}
{"path":"expdphr-28-10-20-01.dmp.tgz","md5":"tgtoAyh79EaAHnG2cMhJ4g==","lastModifiedTime":1603879658104,"size":307998059}

# cat /mnt/orcdts_DAMOED7GH/.bulk_data_transfer/metadata/manifest

{"path":"logFile.log","md5":"PZdMVbAydkbIo3JuJW5HKQ==","lastModifiedTime":1603879758896,"size":26710}

{"path":"bernmobil-opendata.tgz","md5":"J6VvwZemr5ayF+hZmEMvUQ==","lastModifiedTime":1603879648205,"size":132009}

{"path":"expdphr-28-10-20-02.dmp.tgz","md5":"tgtoAyh79EaAHnG2cMhJ4g==","lastModifiedTime":1603879668772,"size":307998059}

{"path":"basel-opendata.tgz","md5":"rRKvfnfw3kjRgp+yyJd9eg==","lastModifiedTime":1603879648180,"size":13816663}

{"path":"sbb-opendata.tgz","md5":"iggsOeCuvpE+zDlwoYmXcA==","lastModifiedTime":1603879699757,"size":223666017}

{"path":"bundesverwaltung-opendata.tgz","md5":"Pbs8W5rNpqs+x48bb/wVQw==","lastModifiedTime":1603879649038,"size":28493853}

{"path":"RMAN_CDB118_28102020.tgz","md5":"6ivSfbVKHceQ6FMy2xVSNA==","lastModifiedTime":1603879692329,"size":695625592}

{"path":"expdphr-28-10-20-01.dmp.tgz","md5":"tgtoAyh79EaAHnG2cMhJ4g==","lastModifiedTime":1603879658104,"size":307998059}

7. Lock the Disk

# dts disk lock --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH --block-device /dev/sdb
Copying upload user credentials.
created object BulkDataTransferTestObject in bucket data_transfer_usb
overwrote object BulkDataTransferTestObject in bucket data_transfer_usb
inspected object BulkDataTransferTestObject in bucket data_transfer_usb
read object BulkDataTransferTestObject in bucket data_transfer_usb
Scanning filesystem to validate manifest. If special files are encountered, they will be listed below.
validated manifest
/dev/sdb DAMOED7GH is encrypted and locked
Locked disk.

# dts disk lock --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH --block-device /dev/sdb

Copying upload user credentials.

created object BulkDataTransferTestObject in bucket data_transfer_usb

overwrote object BulkDataTransferTestObject in bucket data_transfer_usb

inspected object BulkDataTransferTestObject in bucket data_transfer_usb

read object BulkDataTransferTestObject in bucket data_transfer_usb

Scanning filesystem to validate manifest. If special files are encountered, they will be listed below.

validated manifest

/dev/sdb DAMOED7GH is encrypted and locked

Locked disk.

8. Attach the Disk to the Transfer Label and create the Package

The status now changes to ACTIVE.

# dts disk attach --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH --package-label PDQ0QMLNT
Attached disk: DAMOED7GH to package: PDQ0QMLNT

1 2	# dts disk attach --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --disk-label DAMOED7GH --package-label PDQ0QMLNT Attached disk: DAMOED7GH to package: PDQ0QMLNT

9. Shipping and Shipping Information Update

As shipping company I used DHL Switzerland. They have a pick point near by in Langenthal. At this point, it’s important to organize the return shipping too and put the return shipping label in the box. I didn’t realize it and have forgotten to organize the return shipping. So the disk was stranded in the Frankfurt data center. And then the story began. As a private person, the delivery companies DHL and UPS doesn’t allow private persons to re-import packages from outside Switzerland without a customer number. But, private persons don’t get such a number. Finally with FedEx I was able to organize the return shipping. Thanks to Andrew and Christos from Oracle’s OCI Data Transfer team for their patience!

Note: Companies like DHL have templates to create pro-forma commercial invoices – https://www.dhl.ch/exp-de/express/zollabwicklung/zollpapiere/proforma_rechnung.html#invoice

This disk was sent to the Oracle Cloud Infrastructure data center Frankfurt.

Now the shipping information has to be updated with vendor and the tracking numbers.

# dts package ship --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --package-label PDQ0QMLNT --package-vendor DHL --tracking-number 5542918614 --return-tracking-number 12345678
Update package: PDQ0QMLNT

1 2	# dts package ship --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --package-label PDQ0QMLNT --package-vendor DHL --tracking-number 5542918614 --return-tracking-number 12345678 Update package: PDQ0QMLNT

10. Tracking

DHL required two days until delivery in Frankfurt. Oracle started one day later with the data import.

11. Data Processing

Then Oracle is uploading the data and the disk is attached, the job transfer status changes to PROCESSING.

# dts package show --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --package-label PDQ0QMLNT
Transfer Package :
Label : PDQ0QMLNT
TransferSiteShippingAddress : Telehouse c/o Oracle Data Transfer Service; Christos Panoudis; Phone: +49152 22882673 Job:J5Y0R5KAS Package:PDQ0QMLNT ; Kleyerstraße 75-87; 60326 Frankfurt am Main; Germany
DeliveryVendor : DHL
DeliveryTrackingNumber : 5542918614
ReturnDeliveryTrackingNumber : 12345678
Status : PROCESSING
Devices :
[1] :
Label : DAMOED7GH
SerialNumber : WD-WX61E82FY633
UploadStatusLogURL : J5Y0R5KAS/DAMOED7GH/upload_summary.txt
Status : PROCESSING

# dts package show --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --package-label PDQ0QMLNT

Transfer Package :

Label : PDQ0QMLNT

DeliveryVendor : DHL

DeliveryTrackingNumber : 5542918614

ReturnDeliveryTrackingNumber : 12345678

Status : PROCESSING

Devices :

[1] :

Label : DAMOED7GH

SerialNumber : WD-WX61E82FY633

UploadStatusLogURL : J5Y0R5KAS/DAMOED7GH/upload_summary.txt

Status : PROCESSING

12. Data Verification

Finally the data is arrive in the Oracle Cloud Infrastructure Object Storage and is ready for use. The file processing is logged in the new created file upload_summary.txt.

# dts package show --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --package-label PDQ0QMLNT
Transfer Package :
Label : PDQ0QMLNT
TransferSiteShippingAddress : Telehouse c/o Oracle Data Transfer Service; Christos Panoudis; Phone: +49152 22882673 Job:J5Y0R5KAS Package:PDQ0QMLNT ; Kleyerstraße 75-87; 60326 Frankfurt am Main; Germany
DeliveryVendor : DHL
DeliveryTrackingNumber : 5542918614
ReturnDeliveryTrackingNumber : 12345678
Status : PROCESSING
Devices :
[1] :
Label : DAMOED7GH
SerialNumber : WD-WX61E82FY633
UploadStatusLogURL : J5Y0R5KAS/DAMOED7GH/upload_summary.txt
Status : PROCESSING


########################################################################################################################################################################################################
######################################### SUMMARY FOR DEVICE [WD-WX61E82FY633] ############################################
Generated at 2020-11-02 18:27:35
TOTAL: 8
### P present: 8
### M missing: 0
### C name collision: 0
### U unreadable: 0
### N nameTooLong: 0
########################################################################################################################################################################################################
| STATUS | NAME | LAST_MODIFIED | SIZE(MB) | MD5 | ETag |
| present | RMAN_CDB118_28102020.tgz | Mon Nov 02 18:27:36 UTC 2020 | 663.40 | 6ivSfbVKHceQ6FMy2xVSNA== | 99baa855-b15c-4f79-bfaa-dbf16385a182 |
| present | logFile.log | Mon Nov 02 18:27:16 UTC 2020 | 0.05 | Aepiez79Y7/WZYweOWA40w== | 894a88ee-c2f2-454b-875a-0bc3339ff6ab |
| present | bernmobil-opendata.tgz | Mon Nov 02 18:27:16 UTC 2020 | 0.13 | J6VvwZemr5ayF+hZmEMvUQ== | 38aa09fa-46f7-4009-8f8d-b710a43fe74f |
| present | expdphr-28-10-20-02.dmp.tgz | Mon Nov 02 18:27:29 UTC 2020 | 293.73 | tgtoAyh79EaAHnG2cMhJ4g== | 78094b66-6366-464a-9c93-3d4a4e1be3ca |
| present | basel-opendata.tgz | Mon Nov 02 18:27:17 UTC 2020 | 13.18 | rRKvfnfw3kjRgp+yyJd9eg== | f70fb2e9-baf2-40b1-a1dc-7522e6005d66 |
| present | bundesverwaltung-opendata.tgz | Mon Nov 02 18:27:19 UTC 2020 | 27.17 | Pbs8W5rNpqs+x48bb/wVQw== | 20f46883-2e13-4655-8c63-ff455db81fba |
| present | sbb-opendata.tgz | Mon Nov 02 18:27:26 UTC 2020 | 213.30 | iggsOeCuvpE+zDlwoYmXcA== | 90b81b13-611d-440a-9915-35c53e46b10b |
| present | expdphr-28-10-20-01.dmp.tgz | Mon Nov 02 18:27:29 UTC 2020 | 293.73 | tgtoAyh79EaAHnG2cMhJ4g== | 258c26c8-6d2f-4fba-864f-b03062de699e |
########################################################################################################################################################################################################

# dts package show --job-id ocid1.datatransferjob.oc1.eu-frankfurt-1.antheljszffzlryauwznondp2zp6rztpbvzyekv12345671234567 --package-label PDQ0QMLNT

Transfer Package :

Label : PDQ0QMLNT

DeliveryVendor : DHL

DeliveryTrackingNumber : 5542918614

ReturnDeliveryTrackingNumber : 12345678

Status : PROCESSING

Devices :

[1] :

Label : DAMOED7GH

SerialNumber : WD-WX61E82FY633

UploadStatusLogURL : J5Y0R5KAS/DAMOED7GH/upload_summary.txt

Status : PROCESSING

########################################################################################################################################################################################################

######################################### SUMMARY FOR DEVICE [WD-WX61E82FY633] ############################################

Generated at 2020-11-02 18:27:35

TOTAL: 8

### P present: 8

### M missing: 0

### C name collision: 0

### U unreadable: 0

### N nameTooLong: 0

13. Object Storage Replication Policy (optional)

The files are now in the data center Frankfurt, but I want to have them in the Swiss data center region Zurich. Therefore I set a replication policy on level Object Storage. In Zurich, a new bucket called data_transfer_usb_from_FRA is created. And a few minutes later, the files were available in the Object Storage Zurich. Sure, it depends on the file size 😉

Finally…

Detach the transfer disk so the data center guys can send it back to you.

And after a few days…welcome FedEx in Kestenholz / Jurasüdfuss / Solothurn / Switzerland!

Some words about Shipping and Costs

Shipping costs from DHL and Fedex:

Vendor	From	To	Costs
DHL	Langenthal / Switzerland	Frankfurt	79.50 CHF
FedEx	Frankfurt	Kestenholz	130.45 CHF

Summary

To watch nice marketing slides and documents about cool features is not enough. To find out how it works in the real word, a real is test is required. How to migrate data into a data center of any cloud provider should be basic know-how of each consultant which is working with and on cloud themes. Moving data by a disk ro an appliance opens a lot of possibilities for data migrations into the cloud. For example a huge DWH: Transfer the RMAN backup into the cloud, restore it, close the GAP by an incremental backup and synchronize it with Oracle Golden Gate. #ilike

Oracle Cloud Infrastructure