I would like to read a GZIP compressed Parquet file from GCS into BigQuery using the Python SDK for Apache Beam. However the apache_beam.io.parquetio.ReadFromParquet
method doesn't seem to support reading from compressed files. According to the source code source code, the compression type is hardcoded to UNCOMPRESSED
.
Is there a trick to reading compressed Parquet files without the need to uncompress the files in GCS beforehand? If that is the only way, is there a way to uncompress the file directly in GCS?