Examples Index ============= # Installation and configuration - [Understanding CLASSPATH and Enviroment Variables with Spark on YARN](understanding-classpath-envvars-yarn.md) - [Understanding Spark memory configuration on YARN](spark-memory-yarn.md) # Basic application use - [Introduction to Spark](introduction-to-spark.md) - [How to execute a Spark application via EMR step non-interactively, examples with spark-submit](spark-submit-via-step.md) - [Initializing SparkContext in Scala and Java](initializing-sparkcontext.md) - [Using Spark HiveContext with cluster deployment mode on YARN](using-hivecontext-yarn-cluster.md) # Code examples - [A basic WordCount (Scala)](word-count/) - [A basic WordCount (Scala) using SparkSQL](wiki-spark-sql/) - [How to read LZO files](reading-lzo-files.md) - [Reading input with custom Hadoop input formats, newAPIHadoopFile() (Java)](spark-java-TeraInputFormat-count.md) - [Using Hive and SparkSQL together with Parquet storage on EMR AMI 3.x](parquet-sparksql-hive-compatibility.md) # Other references - AWS CLI installation and configuration, http://docs.aws.amazon.com/cli/latest/userguide/cli-chap-welcome.html - AWS EMR documentation, http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/ - AWS EMR AMI version information, http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/ami-versions-supported.html - Running Spark on YARN, https://spark.apache.org/docs/latest/running-on-yarn.html