You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/connections/reverse-etl/reverse-etl-source-setup-guides/bigquery-setup.md
+16-11Lines changed: 16 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -70,17 +70,22 @@ You can find the location of your BigQuery resources using the following method:
70
70
3. The Location of the dataset (like US or EU) is displayed in the Dataset Info.
71
71
72
72
## Set up BigQuery as your Reverse ETL source
73
-
1. In the BigQuery console, search for the service account you created.
74
-
2. When your service account pulls up, click the 3 dots under **Actions** and select **Manage keys**.
75
-
3. Click **Add Key > Create new key**.
76
-
4. In the pop-up window, select **JSON** for the key type and click **Create**. The file will be downloaded.
77
-
5. Copy all the content in the JSON file you created in the previous step.
78
-
6. Open the Segment app and navigate to **Connections > Sources**.
79
-
7. On the My sources page, click **+ Add source**.
80
-
8. Search for "BigQuery" and select the BigQuery source from the sources catalog. On the BigQuery overview page, click **Add Source**.
81
-
9. On the Set up BigQuery page, enter a name for your source and paste all the credentials you copied from previous step into the **Enter your credentials** section.
82
-
10. Enter the location of your BigQuery warehouse in the **Data Location** field.
83
-
11. Click **Test Connection** to test to see if the connection works. If the connection fails, make sure you have the right permissions and credentials and try again.
73
+
1. In the BigQuery console, search for the service account you created.
74
+
2. When your service account pulls up, click the 3 dots under **Actions** and select **Manage keys**.
75
+
3. Click **Add Key > Create new key**.
76
+
4. In the pop-up window, select **JSON** for the key type and click **Create**. The file will be downloaded.
77
+
5. Copy all the content in the JSON file you created in the previous step.
78
+
6. Open the Segment app and navigate to **Connections > Sources**.
79
+
7. On the My sources page, click **+ Add source**.
80
+
8. Search for "BigQuery" and select the BigQuery source from the sources catalog. On the BigQuery overview page, click **Add Source**.
81
+
9. On the Set up BigQuery page, enter a name for your source and paste all the credentials you copied from previous step into the **Enter your credentials** section.
82
+
10. Enter the location of your BigQuery warehouse in the **Data Location** field.
83
+
11. Click **Test Connection** to test to see if the connection works. If the connection fails, make sure you have the right permissions and credentials and try again.
84
84
12. If the test connection completes successfully, click **Add source** to complete the setup process.
85
85
86
+
When setting up a BigQuery Reverse ETL source, you can choose which API Segment uses to read from BigQuery. You can make this selection during the initial setup, or later from **Connections > Sources > Reverse ETL > BigQuery Source > Settings > Connection Settings**. You can choose from:
87
+
- **REST API**: This is recommended for most tables. REST is generally more cost-efficient, but syncs may be slower for very large datasets.
88
+
- **Storage API**: This is recommended for large tables. The Storage API can significantly improve throughput and reduce sync times, but may incur higher costs. See [BigQuery Storage API client libraries](https://cloud.google.com/bigquery/docs/reference/storage/libraries) and [BigQuery pricing for data extraction](https://cloud.google.com/bigquery/pricing?hl=en#data_extraction_pricing){:target="_blank"} for more information.
89
+
90
+
86
91
After you've added BigQuery as a source, you can [add a model](/docs/connections/reverse-etl/setup/#step-2-add-a-model) and follow the rest of the steps in the Reverse ETL setup guide.
0 commit comments