Invoke Configuration Page

Configure the action you selected on the Basic Info page.

Initiate Bulk Load/Extract

Element Description

Select Job Type
If you select Extract, specify/select the following values:
  • Select Dataset ID
  • Select Source Table ID
  • Select Google Cloud Storage Bucket
  • Provide File Name
  • Destination Format
If you select Load, specify/select the following values:
  • Select Dataset ID
  • Select Destination Table ID
  • Select Google Cloud Storage Bucket
  • Source Format

Select Dataset ID

Select the BigQuery dataset that contains the source or destination table for the load or extract operation. The list of datasets is retrieved from the configured Google Cloud project.

Select Source Table ID

Select the BigQuery table from which to extract data. This field is displayed when Extract is selected as the job type.

Select Destination Table ID

Select the BigQuery table into which to load data. This field is displayed when Load is selected as the job type.

Select Google Cloud Storage Bucket

Select the Google Cloud Storage bucket to use as the source location for load operations or the destination location for extract operations.

Provide File Name

Enter the name of the file to create (for extract) or reference (for load) in the selected Google Cloud Storage bucket.

Source Format

Select the format of the source file to load into BigQuery (for example, CSV, JSON, Avro, or other supported formats).

Destination Format

Select the format in which to write the extracted data to the Google Cloud Storage bucket (for example, CSV, JSON, Avro, or other supported formats).

Get Query Status/Results by Job ID

Element Description

Provide SQL Query

Enter a SQL query to retrieve data from BigQuery tables.

Note: You must provide the same SQL query that was configured during the query operation.

Query

Element Description

Request Type
  • Synchronous
  • Asynchronous

Provide SQL Query

Enter the SQL statement to execute against the selected BigQuery dataset and tables. The query must follow BigQuery standard SQL syntax.

Example query: 
"UPDATE `{{projectId}}.{{datasetID}}.{{tableID}}` 
SET Price = @new_price WHERE ProductID = @pid"
Example query parameters format (named parameters):
{
     "queryParameters": [
         {
             "name": "new_price",
             "parameterType": {
                 "type": "NUMERIC"
             },
             "parameterValue": {
                 "value": "26"
             }
         },
         {
             "name": "pid",
             "parameterType": {
                 "type": "INT64"
             },
             "parameterValue": {
                 "value": "1"
             }
         }
     ]
 }

Note:

(Important): If you select the Test Query option during design time, the query is executed immediately.
  • If the query modifies data (INSERT, DELETE, or UPDATE), the table is altered at design time.

Be cautious when testing queries during adapter configuration.

Perform List Table Data:

Element Description
Select Dataset ID Select the BigQuery dataset that contains the table from which you want to retrieve data.
Select Table ID Select the BigQuery table whose data you want to list.

Perform Insert rows in table:

Element Description
Select Dataset ID Select the BigQuery dataset that contains the table into which to insert rows.
Select Table ID Select the BigQuery table into which to insert one or more rows during runtime.