Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The UITS DBA team developed and maintains a series of scripts to refresh the non-prod Kuali databases from the most recent (nightly) production schema level export file.  This process allows the Kuali non-prod environments to contain a highly relevant set of data for development, testing, training, and production trouble-shooting.  The scripts are automated by environment in Control-M jobs. Refreshes are initiated by submitting a  

These are the steps to perform a data refresh :

  1. Log into Control-M

...

  1. .
  2. Click the "Order Service" button at the top of the page.
  3. Select the desired environments to refresh.
  4. Open the refresh job and confirm the first step by right-clicking on the step and choosing "confirm"

The automated jobs contain all of the actions necessary to take the application servers offline, perform the refresh, and then restore the application servers to an available state.  The refresh process also includes scripts executes the cleansePIIData.sql script to restore the test version of the encryption key and java object, and to falsify and re-encrypt the contents of all sensitive data fields.  This script does not re-encrypt CLOB data.  A separate process is required for that.

** Due to the size of the production attachments table, we do not populate the attachments in the refreshed environments.  The empty table structure is created but not populated.  

Sample request form

Feb 3 2015 Refresh KFS Environments Request.docx

Refreshes are performed at the start of each month (following a successful month end process).  The above form is an example of a recent request to refresh all of the non-prod environments.


Unique environment:

DR Environment

...

  • the java object in the DR schemas must be replaced with the test version of java object. (Dave Raines)  
    • *** Tip: to determine if the java object in the database schema is the test version or prod version, follow these steps:
      1. using SQL Developer or Toad, connect to the schema in question
      2. under the java node, confirm that the status field of the java object is "valid"
      3. View the source of the encryption class
      4. The value of the instance variable 'secretkey' identifies if it is prod or non-prod
  • the encryption key in the security file on the application servers is replaced with the test key. (Ben Daniels)

 

Refresh

...

DateTarget Environment(PRD) Source backup date RequestorReasonForm 
 TRN Pam KPost month end refreshFeb 3 2015 Refresh KFS Environments Request.docx
 SUP Pam KPost month end refreshFeb 3 2015 Refresh KFS Environments Request.docx
 YE Pam KPost month end refreshFeb 4 2015 Repeat failed Refresh YEN Environment.docx
 UAT 

Pam K 

Post month end refreshFeb 3 2015 Refresh KFS Environments Request.docx
 DEV Pam KPost month end refreshFeb 3 2015 Refresh KFS Environments Request.docx
 DR Pam K

Post month end refresh

Feb 3 2015 Refresh KFS Environments Request.docx

...

Schedule

Ad Hoc refreshes can be performed at any time by contacting the KFS Dev team.

Scheduled refreshes are performed during the week after a release.  Specific schedules can be found in the Planned Releases checklists.

Requirements

EnvironmentPII Script ExecutionEncryption following PII scripts
DEVYesYes
YEYesYes
UATYesYes
SUPNo*No (data already encrypted from import)
TRNYesYes
DR (not for DR)YesYes

...