When spark reads data out of hdfs, what is the process that interfaces directly with hdfs?
Answers
Answered by
1
With Spark you can read data from HDFS and submit jobs under YARN resource ... with HDFS data using Spark Python interface also known as PySpark. .... Now read this file directly from HDFS
Similar questions
English,
6 months ago
Biology,
6 months ago
Math,
6 months ago
Social Sciences,
1 year ago
Social Sciences,
1 year ago