- Notifications
You must be signed in to change notification settings - Fork 2
Sources
Andrei Tupitcyn edited this page Dec 23, 2015
·
2 revisions
Read a text file from HDFS, a local file system, or any Hadoop-supported file system URI. Use SparkContext.textFile method.
| Configuration key | Default | Description |
|---|---|---|
| path | - | List of paths to read. Path can be a file or directory. |
| filters* | defaultHadoopFilter | List of path filters. |
- Path filter is a simple function defined as
type PathFilter = Path => Boolean. Available filter types you can find here.