Invalid value at 'start_index' (TYPE_UINT64), "1e+05" [invalid] issue while downloading data to R from BigQuery

Question

I successfully connected Google BigQuery with the R environment using the bigrquery package.

I have defined a sql statement which extracts a report. While using the bq_table_download function, I get the following error.

Invalid value at 'start_index' (TYPE_UINT64), "1e+05" [invalid]

Code:

sql <- "SELECT * FROM ABC"

df <- bq_project_query(billing, sql)

data <- (bq_table_download(df))

There is very little help on this issue. Thank you in advance.

Answer 1

The issue is caused as BigQuery allows only 100k records to be downloaded. Adding the options(scipen = 20) script to the start of your code will solve the issue.

Answer 2

This was just fixed in PR#400 by @gjuggler

updating the bigrquery package to the latest version will fix your issue.

remotes::install_github("r-dbi/bigrquery")