Trying to read a file located in S3 using spark-shell:

    scala&gt; val myRdd = sc.textFile(&quot;s3n://myBucket/myFile1.log&quot;)
    lyrics: org.apache.spark.rdd.RDD[String] = s3n://myBucket/myFile1.log MappedRDD[55] at textFile at &lt;console&gt;:12
    
    scala&gt; myRdd.count
    java.io.IOException: No FileSystem for scheme: s3n
    	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2607)
    	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2614)
    	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
        ... etc ...

The **IOException: No FileSystem for scheme: s3n** error occurred with:

- Spark 1.31 or 1.40 on dev machine (no Hadoop libs)
- Running from the [Hortonworks Sandbox HDP v2.2.4](http://hortonworks.com/hdp/downloads/) (Hadoop 2.60) which integrates Spark 1.2.1 out of the box
- Using s3:// or s3n:// scheme

What is the cause of this error? Missing dependency, Missing configuration, or mis-use of `sc.textFile()`?

Or may be this is due to a bug that affects Spark build specific to Hadoop 2.60 as this [post](http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-1-3-1-Hadoop-2-6-package-has-broken-S3-access-td12107.html) seems to suggest. I am going to try Spark for Hadoop 2.40 to see if this solves the issue.

All Hortonworks Data-Platform Solutions on Gang of Coders

Total of 1 Hortonworks Data-Platform Solutions

Spark read file from S3 using sc.textFile ("s3n://...)