Is it possible to read a parquet file in parallel ?
I'm using something similar to what is described here (based on AvroParquetReader): how to read a parquet file, in a standalone java code? but this is done in sequence not in parallel.
Cheers !
Join Stack Overflow to learn, share knowledge, and build your career.
Is it possible to read a parquet file in parallel ?
I'm using something similar to what is described here (based on AvroParquetReader): how to read a parquet file, in a standalone java code? but this is done in sequence not in parallel.
Cheers !
The only way I found is to have an executor pool and every worker of this pool reads one of the parquet file.