When spark reads data out of hdfs, what is the process that interfaces directly with hdfs?
Answers
Answered by
1
With Spark you can read data from HDFS and submit jobs under YARN resource ... with HDFS data using Spark Python interface also known as PySpark. .... Now read this file directly from HDFS
Similar questions
Computer Science,
6 months ago
World Languages,
6 months ago
Social Sciences,
11 months ago
Chemistry,
11 months ago
Social Sciences,
1 year ago