Node Description

The Google BigQuery node enables you to execute SQL queries on BigQuery datasets and retrieve specific columns for further processing or analysis. This tool supports dynamic input parameters.


Node Inputs

Required Fields

  1. Google Cloud Project
    The name of your Google Cloud project where BigQuery is enabled.
    Example: "my-cloud-project"

  2. BigQuery SQL Query
    A valid SQL query to retrieve data from the BigQuery dataset.
    Example:

    SELECT name 
    FROM `bigquery-public-data.usa_names.usa_1910_2013` 
    WHERE state = "TX"
    
  3. Column Name
    The specific column name from the query output to extract data or * to extract all the columns from the result of the query.

    Example with column name: "state" Response:

    [
       "TX",
       "TX"
    ]
    

    Example with column name: "*"

    [
       "TX, F, 1910, Mary, 895",
       "TX, F, 1910, Roberta, 37"
    ]
    
  4. Row Limit
    The maximum number of rows to retrieve. Default is 100.
    Example: 500


Node Output

The Google BigQuery node provides the following output:

  1. Column Outputs
    • A list of values from the specified column in the SQL query.
    • Example Output:
      ["Michael", "Jessica", "Matthew", "Ashley"]
      

Example Usage

1. Retrieve Names by State

Google Cloud Project: "my-cloud-project"
BigQuery SQL Query:

SELECT name 
FROM `bigquery-public-data.usa_names.usa_1910_2013` 
WHERE state = "CA"

Column Name: "name"
Row Limit: 4

Output:

["James", "Mary", "John", "Patricia"]

2. Extract Top Sales Data

Google Cloud Project: "ecommerce-data-project"
BigQuery SQL Query:

SELECT product_name, SUM(quantity_sold) as total_sold 
FROM `ecommerce_data.sales` 
GROUP BY product_name 
ORDER BY total_sold DESC 
LIMIT 10

Column Name: "product_name"

Output:

["Laptop", "Smartphone", "Headphones", "Tablet"]

3. Extract data with dynamic parameter

Google Cloud Project: "my-project"
BigQuery SQL Query:

SELECT name 
FROM `bigquery-public-data.usa_names.usa_1910_2013` 
WHERE state = {{state}}

Column Name: "*"

Output:

[
  "TX, F, 1910, Mary, 895",
  "TX, F, 1910, Roberta, 37",
  "TX, F, 1910, Marguerite, 42"
]

Node Functionality

The Google BigQuery node streamlines the process of querying BigQuery datasets and extracting meaningful data. With its flexibility, you can use it for:

  • Retrieving specific data points for analysis.
  • Aggregating and summarizing data with SQL queries.
  • Preparing datasets for further processing in workflows.

This node is ideal for seamless integration of BigQuery data into automation workflows.


Tool activation

You must activate the tool via the Integrations menu. You must authenticate with Google Oauth and your administrator must give you the correct IAM roles in order to access BigQuery in your GCP account and project as specified in the Google Cloud Project input field. example IAM roles assigned to a user:

BigQuery Admin 
(roles/bigquery.admin)
or
BigQuery Data Viewer 
(roles/bigquery.dataViewer)