Skip to main content

Ingest from ServiceNow as Parquet

Copy data from ServiceNow to Parquet format in Azure Data Lake Storage Gen2.

Category: Ingest to Lakehouse | Tags: Ingestion

To use this activity within the API, use an ActivityCode of SERVICENOW-BASIC-ADLS.

Available Connections​

SourceConnection:

TargetConnection:

Example JSON​

An example of what the Task Config would look like for a task using this activity. Some of these variables would be set at the group level to avoid duplication between tasks.

{
  "SourceConnection": "MY-SOURCE-CONN",
  "ServiceNowTable": "",
  "DataLakeSystemFolder": "my_folder",
  "DataLakeDatasetFolder": "data",
  "TargetConnection": "MY-TARGET-CONN",
  "DeltaSchemaName": "example_schema",
  "DeltaTableName": "my_table"
}

Variable Reference​

The following variables are supported:

  • DataLakeDatasetFolder (Required) - Name of the folder in the Data Lake containing the dataset.

  • DataLakeSystemFolder (Required) - Name of the parent (System) folder in the Data Lake containing the dataset.

  • DeltaSchemaName (Optional) - The name of the Schema this transformation lives in.

  • DeltaTableName (Optional) - The name of the Table representing this transformation.

  • ElevateToDelta (Optional) - Ingest directly to Lakehouse Table

  • ExtractControlVariableName (Optional) - For incremental loads only, the name to assign the Extract Control variable in State Config for the ExtractControl value derived from the Extract Control Query above.

  • ExtractControlVariableSeedValue (Optional) - The initial value to set for the Extract Control variable in State Config - this will have no impact beyond the original seeding of the Extract Control variable in State Config.

  • FilteringQuery (Optional) - The JSON struct that defines the filtering criteria to apply.

  • ServiceNowPageSize (Optional) - The page size of the ServiceNow resultset.

  • ServiceNowTable (Required) - The name of the ServiceNow table to extract.

  • SourceConnection (Required) - Source connection to use.

  • TargetConnection (Optional) - Target connection to use.