5 of 6
deleted 1114 characters in body
Charlie Egan
  • 4.9k
  • 6
  • 33
  • 49

Table contains data but there is a delay in flushing of streaming buffer

I have a Go program which downloads data from a table (T1), formats it, and uploads it to a new temporary table (T2). Once the data has been uploaded (30s or so), the data should be copied to a third table (T3).

After uploading the formatted data to T2, querying the table returns results ok. However, when copying the table - the job completes almost instantly and the destination table (T3) is empty.

I'm copying the table as suggested here - but the result is the same when performing the action in the UI.

In the table metadata section it shows as 0B, 0 rows but there are about 100k rows and 18mb of data in there - or at least that's what comes back from a query.

Edit I did not spot that this data was still stuck in the streaming buffer - see my answer.

Charlie Egan
  • 4.9k
  • 6
  • 33
  • 49