Google Cloud Professional Data Engineer PDE — Topic 1 Question 193

Question

An aerospace company uses a proprietary data format to store its flight data. You need to connect this new data source to BigQuery and stream the data into BigQuery. You want to efficiently import the data into BigQuery while consuming as few resources as possible. What should you do?

Accepted Answer

Correct answer: D. The correct answer is D. Option D: Use an Apache Beam custom connector to write a Dataflow pipeline that streams the data into BigQuery in Avro format. BigQuery is a serverless, petabyte-scale data warehouse for fast SQL analytics with no infrastructure to manage. Dataflow runs serverless Apache Beam pipelines for stream and batch data processing with autoscaling.

Google Cloud Professional Data Engineer PDE — Question 193