Bq命令或数据流为负载

时间:2022-06-01 21:36:15

I have a simple delimited file on gcs. I need to load that file as is(without transfermation) to bigqyery table. Either we can use data flow or bigqyery command line utility to load that file to bigqyery table. I need to understand which one is the best option bigqyery or bq command line utility. Please consider factors like cost, performance etc before providing your valuable inputs.

我在gcs上有一个简单的分隔文件。我需要按原样加载该文件(不转移)到bigqyery表。我们可以使用数据流或bigqyery命令行实用程序将该文件加载到bigqyery表。我需要了解哪一个是bigqyery或bq命令行实用程序的最佳选择。在提供有价值的投入之前,请考虑成本,性能等因素。

1 个解决方案

#1


2  

Running a BigQuery load using Dataflow or running it using bq command line is the same in terms of cost. Using bq load directly should be easier if you don't need to process the data.

使用Dataflow运行BigQuery加载或使用bq命令行运行它在成本方面是相同的。如果您不需要处理数据,则应该更容易直接使用bq load。

#1


2  

Running a BigQuery load using Dataflow or running it using bq command line is the same in terms of cost. Using bq load directly should be easier if you don't need to process the data.

使用Dataflow运行BigQuery加载或使用bq命令行运行它在成本方面是相同的。如果您不需要处理数据,则应该更容易直接使用bq load。