Describe the enhancement requested
Use the hadoop openFile() builder API to open a file, passing down
- the existing FileStatus (saves a HEAD on cloud stores)
- a read policy appropriate for parquet files. This ensures that the object stores know what kind of GET/prefect/cache to do.
Component(s)
Core
Describe the enhancement requested
Use the hadoop
openFile()builder API to open a file, passing downComponent(s)
Core