In each IT data mart,
the following sets of objects are created for each migrated SAS IT
Resource Management 2.6 or 2.7 collector:
-
-
simple aggregation tables
-
summarized aggregation tables
-
the libraries for these tables
-
jobs that load these tables
-
Aggregation
and
Staging
folders
to provide organization of these objects
Folders Created for Each Adapter
Contents
of the Staging Folder
All objects that are
related to staging data for a given adapter are in the Staging folder
for that adapter. This includes the following objects:
-
a SAS library to hold the data
for all staged tables for this staging transformation instance
-
the staged tables needed for this
adapter, as determined by the PDB
-
a job to stage the data for this
adapter
Staged tables are populated
by user-written staging code or staging transformations that SAS IT
Resource Management supplies. These tables hold the metrics that are
presented by the data source adapter. If the adapter being migrated
is supported by SAS IT Resource Management 3.3, then the staging job
for the adapter has a staging transformation for the specific adapter
as the starting point of the job. Otherwise, the first element of
the job is a user-written staging transformation. In either case,
the outputs of the first transformation of the staging job are the
staged tables for the adapter.
The %RMPDB2DM macro
determines the columns that are needed for each staging table by determining
the columns that are in existence in the SAS IT Resource Management
PDB. Staged tables can also include computed column definitions.
For information about
these definitions, see Formulas.
Contents
of the Aggregation Folder
All objects that are
related to the aggregation of data for a given adapter are in the
Aggregation
folder
for that adapter. For each staged table in the
Staging
folder,
there is a corresponding subfolder in the
Aggregation
folder.
The following objects are in the subfolder for each staged table:
-
a SAS library to hold the data
for all aggregation tables that are produced from the staged table
-
aggregation tables that corresponding
to the DETAIL, DAY, WEEK, MONTH, and YEAR tables in SAS IT Resource
Management 2.6 and 2.7
-
a job to populate the aggregation
tables
Aggregation Folder Contents
An aggregation job is
created for each table that is staged by the staging job. The aggregation
job starts with the staged table as the input to an Aggregation transformation.
This transformation functions similarly to the SAS IT Resource Management
2.6 and 2.7 %CxPROCES and %CPREDUCE macros. As shown in the following
display, the outputs of the Aggregation transformation are the simple
and summarized aggregation tables.
Simple Aggregation
Tables
Simple aggregation tables
are analogous to the SAS IT Resource Management 2.6 or 2.7 DETAIL
tables. The following table shows how the functions available in SAS
IT Resource Management 2.6 and 2.7 can be accomplished in SAS IT Resource
Management 3.3.
Comparison of DETAIL Level Tables and Simple Aggregation Tables
|
SAS IT Resource Management
2.6 and 2.7
|
SAS IT Resource Management
3.3
|
How to purge existing
data from a table before loading new data into that table
|
An age limit of 0 for
the DETAIL level was a special setting that caused %CPREDUCE to purge
the DETAIL table after it was summarized.
|
Specify the following
settings in the Specify purging and aging criteria page
of the Summarized Aggregation :
-
Ensure that the check box for Purge
output table before loading new data is selected.
-
Ensure that the check box for Perform
aging for output table is not selected.
Configuring these specifications
causes the existing data in the simple aggregation How to load table
to be purged before loading new data when the aggregation transformation
is executed.
|
How to load data that
is older than the specified age limit
|
Data could be loaded
into the DETAIL level even if it should be aged out based on the age
limit settings. The purpose of this capability was to allow post-processing
(such as user-written chargeback routines) to read the DETAIL data.
|
Select the option Allow
incoming data even if it precedes the age limit to enable
this same functionality for simple aggregation tables that have been
migrated.
|
|
The table name was the
same at each level of the PDB.
|
The simple aggregation
table that is created by migration is named < table-name>_DETAIL
(for example, SARDEV_DETAIL).
|
Summarized
Aggregation Tables
Summarized aggregation
tables are analogous to the DAY, WEEK, MONTH, and YEAR tables in SAS
IT Resource Management 2.6 and 2.7. The following table shows how
the functions available in SAS IT Resource Management 2.6 and 2.7
can be accomplished in SAS IT Resource Management 3.3.
Comparison of DAY, WEEK, MONTH, and YEAR Level Tables and Summarized
Aggregation Tables
|
SAS IT Resource Management
2.6 and 2.7
|
SAS IT Resource Management
3.3
|
How to deactivate summarization
|
An age limit of 0 for
a summary level table would deactivate summarization for that level.
|
To deactivate summarization,
do not create a summary aggregation table.
|
How aging columns are
named
|
The aging column for
all summary levels was always named DATETIME.
|
A separate aging column
(that is named appropriate to the summarization) is used to support
the aging. These aging columns are created as computed columns in
the staged tables. The names of these columns are DAYDATE, WEEKDATE,
MONTHDATE, and YEARDATE.
The WEEKDATE column
honors the SAS IT Resource Management 2.6 and 2.7 START OF WEEK setting
from the PDB.
|
|
The table name was the
same at each level of the PDB.
|
The summarized aggregation
table created by migration is named < table-name>_< level>
(for example, SARDEV_WEEK).
|