Google Cloud Professional Data Engineer PDE — Topic 1 Question 280

Question

You are running a streaming pipeline with Dataflow and are using hopping windows to group the data as the data arrives. You noticed that some data is arriving late but is not being marked as late data, which is resulting in inaccurate aggregations downstream. You need to find a solution that allows you to capture the late data in the appropriate window. What should you do?

Accepted Answer

Correct answer: A. The correct answer is A. Option A: Use watermarks to define the expected data arrival window. Allow late data as it arrives. This option meets the real-time / low-latency performance requirement.

Google Cloud Professional Data Engineer PDE — Question 280