Target Types

Target parameters include:
ParameterRequired/OptionalDescription
source_idRequiredUnique source ID.
system_idRequiredUnique system ID.
batch_typeOptionalRecords.
batch_countOptionalNumber of records to batch. The batch_type parameter is required when using batch_count.
use_dead_letter_queueOptionalTrue/false.

Teradata

A Teradata target requires additional parameters: schema and table in data_path, username and password in system_info.

{
  "target_type": "teradata",
  "data_path": {
    "schema": "schema",
    "table": "table"
  },
  "data_map": {
    "mapping": [
      {
        "column": "db_column_name",
        "field": "data",
        "type": "json"
      }
    ]
  },
  "system_info": {
    "username": "ip112233",
    "password": "password"
  }
}

Aster

An Aster target requires additional parameters: schema and table in data_path, username and password in system_info.

{
  "target_type": "aster",
  "data_path": {
    "schema": "schema",
    "table": "table"
  },
  "data_map": {
    "mapping": [
      {
        "column": "db_column_name",
        "field": "data",
        "type": "json"
      }
    ]
  },
  "system_info": {
    "username": "ip112233",
    "password": "password"
  }
}

HDFS without Kerberos

A HDFS target requires additional parameters: path and extension in data_path, username and password in system_info. Only sequence files are supported and require the seq extension.

{
  "target_type": "hdfs",
  "data_path": {
    "path": "/data/listener/",
    "extension": "seq"
  },
  "properties": {
    "webhcat_table": "listener"
  },
  "system_info": {
    "username": "ip112233",
    "password": "password"
  }
}

HDFS with Kerberos

A HDFS with Kerberos target requires additional parameters: kdc, principal, and base64 encoded keytab in properties.

    "data_path": {
      "extension": "seq",
      "path": "/user/testuser/kerberos"
    },
    "properties":{
        "kdc":"ip-172-29-31-108.us-west-2.compute.internal:88",
        "principal":"testuser@CDH.US-WEST-2.COMPUTE.INTERNAL",
        "base64KeytabContent":"BQIAAABd..."
}

HBase

A HBase target requires additional parameters: schema and table in data_path, username and password in system_info.

{
  "target_type": "hbase",
  "data_path": {
    "schema": "column_family",
    "table": "table"
  },
  "data_map": {
    "mapping": [
      {
        "column": "db_column_name",
        "field": "data",
        "type": "json"
      }
    ]
  },
  "system_info": {
    "username": "ip112233",
    "password": "password"
  }
}

results matching ""

    No results matching ""