۶Ƶ

Dataset rules

Dataset rules assist you in mapping your harmonized fields with fields from the data you ingested in Mix Modeler.

  • For aggregate data that you ingested in ۶Ƶ Experience Platform, you map one or more of the available dataset fields to the appropriate harmonized fields.
  • For event data, you can individually map one or more harmonized fields to fields from the dataset, directly or using conditions.

Manage dataset rules

To see a table of the available dataset rules, in the Mix Modeler interface:

  1. Select DataSearch Harmonized data from the left rail.

  2. Select Dataset rules from the top bar. You see a table of the dataset rules.

The table columns specify details about the dataset rules:

Column name
Details
Dataset
The name of the dataset.
Source
The source of the dataset: ۶Ƶ Analytics, Experience Events, Summary (aggregate), or Consumer Experience Events.
Schema
The schema to which the dataset conforms. You can quickly select the schema name to open the schema in a new tab in the schema editor in Schema Schemas.
Granularity
The granularity of data in the dataset. Possible values are Daily, Weekly, Monthly or Yearly.
Start of the week
Specifies which day of the week is considered the start of a new week for the specific dataset.
Status

The status of the field:

● Draft or

● Active

Last modified
Data and time of the last modification of the dataset rule.

Create a dataset rule

To create a dataset rule, in the DataSearch Harmonized data > Dataset rules interface in Mix Modeler, select Create a dataset rule in the Dataset rules configuration wizard.

In the Create screen,

  1. In Dataset details, select a dataset from Select dataset to begin configuration. In the list, datasets are categorized in Consumer Experience Events, ۶Ƶ Analytics, Experience Event and, Summary.

  2. Select a day for the Start of the week.

  3. Select Daily, Weekly, Monthly or Yearly for Granularity.

  4. When you have selected a dataset of the Summary category, select Aggregation or Replacement for Data restatement is by.

    Reporting data from publishers is very important to marketing analysts since working with publishers often implies significant spend, and changes in the reporting data may result in very different insights and investment plans. Furthermore, marketing analysts need accurate data to derive the right insights and present convincing proposals to gain stakeholder confidence. However, these publishers, such as Google and Facebook, often restate or delete reporting data as they reconcile their data. The time frame for most of the changes is within 7 days of the reported media performance. Additional changes in the data are possible within 30 days. In general, after 30 days, books are considered closed and data complete.

    Mix Modeler supports data restatement. To ensure that the data that is used for reporting, modeling, and planning is accurate. And that the data is able to support the brand and marketing analyst’s expectations and needs.

    You can send restated rows of summary data as incremental rows in an Experience Platform dataset and the harmonization service updates the harmonized dataset with that restated data. Similarly, you can also remove rows of summary data that needs to be reflected in the harmonization service.

  5. In the Map to harmonized fields section:

    1. Select a harmonized field from Standard harmonized field.

    2. When the selected harmonized field is of type metric:

      1. Select Count or Sum from Mapping type.

      2. Select an AEP dataset field that you want the harmonized field to map to by default.

    3. When the selected field is of type dimension:

      1. Select Map Into or Case from Mapping type.

      2. When you have selected Map Into, select Field and AEP dataset field or Value and a default value to map the harmonized field by default to the dataset field or entered value.

      3. When you select Case, select Field and AEP dataset field or Value and a default value to map the harmonized field by default to the dataset field or entered value.

        1. To set values explicitly, you define one or more cases, consisting of one or more conditions. Each condition can check for a specific AEP dataset field whether it Exists or Not Exists or whether it Contains, Not Contains, Equals, Not Equals, Starts With, or Ends With a value entered at Enter input value.

        2. To add another case, select Add Add case, to add another condition, select Add Add condition.

        3. To delete a case or condition, select Close in the corresponding container.

        4. To select whether any or all the conditions should apply for a case, select Any of or All of.

        5. To set the outcome value for a case, enter the value at Then.

      The example below

      • uses a Map Into Mapping type to map the Channel Type At Source harmonized field to the channel_type field from the Luma Transactions dataset.

      • uses a Case Mapping type to map conditionally the value of the marketing.campaignName field in the Luma Transactions dataset to the Campaign harmonized field. The Campaign harmonized field is set to:

        • Black Friday when the marketing.campaignName is _black_friday or BlackFriday.
        • to the value of the marketing.campaignName in all other cases.

        Dataset rule event

      When you map a standard harmonized field from a summary dataset, Mix Modeler tries to deduce the corresponding Experience Platform dataset field. When successful:

      • If the field is of type dimension, Map into is selected as Mapping type.
      • If the field is of type metric, Sum is selected as Mapping type.
      • Field is selected as the Default mapping type.
      • The corresponding Experience Platform dataset field is inserted automatically for AEP Dataset Field.

      You can change any of the proposed values if these are incorrect or not supporting your specific use case.

  6. Select Add Add field to define additional fields.

When finished, select Save as draft to save a draft version of the rule or Save to save and activate the rule. Select Cancel to cancel the rule configuration.

NOTE
The dedicated Map to harmonized fields experience for summary datasets rules is deprecated. All dataset rules now use similar Map to harmonized fields experience, irrespective of dataset type. For summary datasets for which you have defined rules using the deprecated Map to harmonized fields experience, you might want to verify these rules against the generic Map to harmonized field experience.

Edit a dataset rule

To edit a dataset rule, in the DataSearch Harmonized data > Dataset rules interface in Mix Modeler:

  1. Select More in the Dataset column for the dataset rule that you want to edit.
  2. From the context menu, select Edit Edit to start editing the dataset rule. Refer to Create a dataset rule for more details.

Delete a dataset rule

To delete a dataset rule, in the DataSearch Harmonized data > Dataset rules interface in Mix Modeler:

  1. Select More in the Dataset column for the dataset rule that you want to delete.
  2. From the context menu, select Delete Delete to delete the dataset rule. You are prompted for confirmation. Select Delete to delete the selected dataset rule permanently.

Sync data

To sync data between your harmonized data and summary and / or event datasets while applying the logic in your dataset rules:

  1. Select Sync data.

  2. From the Sync data for dataset rules dialog, either select

    • Refresh harmonized data for summary datasets,
    • Refresh harmonized data for event datasets, or
    • Refresh harmonized data for both summary + event datasets.
  3. To start the synchronization based on the defined dataset rules between harmonized data and data in datasets, select Sync. To cancel the synchronization, select Cancel.

    Sync data

Data merge preferences

NOTE
[beta]{class="badge informative"} The Data merge preferences is a beta feature and its functionality is subject to change.

To ensure accurate model predictions, you can define data merge preferences. This functionality enables users to resolve any conflicts post merging of summary level and event level data.

You can configure a default metric preference to be applied in cases of conflicting updates. This default metric can be one of three options:

  • Summary data
  • Sum of summary and event data
  • Event data

When, during harmonization, multiple sources of data try to update a metric field for a given channel, the default preference configured by the user is applied. This preference is applied at the sandbox level unless overridden for certain metric based preferences configured additionally.

Under Metric based preferences, user can configure the specific source (Summary or Event) for a given metric and the corresponding conversion type for that metric.

Typical use cases are:

  • the same advertising metric is measured and reported in multiple datasets, or
  • metrics measurement may be incomplete in some datasets, while another dataset may be a superset of a particular metric, resulting to double counting.

Configure

To configure data merge preferences:

  1. Select Data merge preferences [beta]{class="badge informative"}.

  2. In the Data merge preferences [beta]{class="badge informative"} dialog:

    Data merge preferences

    • Select a Default metric preference. The selected default metric preference is applied when, during harmonization, multiple sources of data update a metric field for a given channel. The preference is applied at the sandbox level, unless overridden for specific metric based preferences. You can select between Summary data, Event data and Sum of summary and event data.

    • To add specific metric based preferences:

      1. Select Plus Add a metric.

        1. Select a metric from the Metric selection list.
        2. Select CHANNELS or CONVERSION TYPES. From the list, select All or a specific channel or conversion type.
        3. Select Summary or Event to specify whether summary data or event data is preferred for the metric (and all or selected channel) when merging data.

        To add one or more additional channel or conversion types:

        1. Select Plus Add a channel or Plus Add a conversion type.
        2. Select Summary or Event.

        To delete a channel or conversion type, select Cross .

      2. To add more specific metric based preferences, repeat the previous step.

    • To delete an existing specific metric based preference, select Delete .

  3. Select Save to save the data merge preferences. A re-sync of the data is initiated.
    Select Cancel to cancel.

Delete a source dataset

When you delete a source dataset that is used in your harmonized data, the underlying entries on that source dataset are removed from the Harmonized data. However, the dataset rule with the deleted source dataset remains in the dataset rule config list with an icon DataRemove indicating that the source dataset has been deleted. To get more details:

  • Select More and Preview View from the context menu.
    The Dataset rule mapping - Fields dialog displays information about the deleted source dataset and the fields used in the dataset rule configuration.

When you return to your Dataset rules configuration, you see a dialog explaining that one or more of the source datasets have been deleted. The harmonized data is impacted on a next ad-hoc or scheduled sync. Review your dataset rule configuration.

The harmonized data is updated without the deleted source data upon the next ad-hoc sync or scheduled sync. However, you continue to see alert dialogs prompting you to delete the dataset rule based on the deleted source dataset. This alert allows users to view and evaluate the impacted fields in the deleted dataset. And to determine the impact to marketing touchpoints or conversions that may be used in any models. Once you have reviewed and mitigated for this impact, you should delete the dataset rule from the dataset rule config list.

recommendation-more-help
d5f9b631-c793-4214-8dc7-f78d1750e4f4