Bigquery

Steps to add a BigQuery data warehouse as a data destination

Step 1: Create service account in BigQuery project

  1. In the GCP console, navigate to the IAM & Admin menu.

My Remote ImageMy Remote Image

  1. Click into the Service Accounts tab.

My Remote ImageMy Remote Image

  1. Click Create service account at the top of the menu.

My Remote ImageMy Remote Image

  1. In the first step, name the user and click Create and Continue.

My Remote ImageMy Remote Image

  1. In the second step, grant the user the role BigQuery User.

My Remote ImageMy Remote Image

  1. In the third and final step, click Done.

  2. Back in the Service accounts menu, click the Actions dropdown next to the newly created service account and click Manage keys.

My Remote ImageMy Remote Image

  1. Click Add key and then Create new key.

My Remote ImageMy Remote Image

  1. Select the JSON Key type and click Create and make note of the key that is generated.

My Remote ImageMy Remote Image

Step 2: Create a staging bucket

  1. Log into the Google Cloud Console and navigate to Cloud Storage. Click Create to create a new bucket.

My Remote ImageMy Remote Image

  1. Choose a name for the bucket. Click Continue. Select a location for the staging bucket. Make a note of both the name and the location (region).

๐Ÿ“˜

๐Ÿšง Choosing a location (region)

The location you choose for your staging bucket must match the location of your destination dataset in BigQuery. When creating your bucket, be sure to choose a region in which BigQuery is supported (see BigQuery regions)

  • If the dataset does not exist yet, the dataset will be created for you in the same region where you created your bucket.
  • If the dataset does exist, the dataset region must match the location you choose for your bucket.
  1. Click continue and select the following options according to your preferences. Once the options have been filled out, click Create.

  2. On the Bucket details page that appears, click the Permissions tab, and then click Add.

My Remote ImageMy Remote Image

  1. In the New principles dropdown, add the Service Account created in Step 1, select the Storage Admin role, and click Save.

My Remote ImageMy Remote Image

Step 3: Find Project ID

  1. Log into the Google Cloud Console and select the projects list dropdown.

  2. Make note of the BigQuery Project ID.

My Remote ImageMy Remote Image

Step 4: Connect BigQuery to Fairing!

Use the form provided by Fairing to connect the BigQuery account you just created.