Apache Scala Over View

What are the objectives of Spark Scala Training?

After the completion of ‘Apache Spark & Scala’ course, you will be able to:

  • Understand Scala and its implementation
  • Apply Lazy values, Control Structures, Loops, Collection, etc.
  • Learn the concepts of Traits and OOPS in scala
  • Understand Functional programming in scala
  • Get an insight into the BigData challenges
  • How spark acts as a solution to these challenges
  • Install spark and implement spark operations on spark shell
  • Understand what are RDDs in spark
  • Implement spark application on YARN (Hadoop)
  • Analyze Hive and Spark SQL Architecture

Apache Scala Course Content

Module-1: Introduction to Spark and Analysis

  • Why second-generation frameworks?
  • Introduction to Spark
  • Scala shell
  • Spark Architecture
  • Spark on Cluster
  • Spark Core
  • SparkSQL
  • Spark Streaming
  • Cluster Managers
  • Spark Users
  • What is use of Spark
  • Spark Versions
  • Spark Storage Layers
  • Download Spark

1. Spark API on a Cluster

  • A. Why second-generation frameworks?
  • B. The Driver
  • C. Executors
  • D. Execution components: jobs, tasks, stages
  • E. Spark Web UI

2. Cluster Manager

  • A. Standalone Cluster Manager
  • B. Hadoop YARN
  • C. Apache Mesos
  • D. Amazon EC2
  • E. Which Cluster Manager?
  • F. Spark-submit for deploying applications
  • G. Using MAVEN for JAVA SPARK application
  • H. Using SBT for A SCALA Application

Module-2: DATALOADING (HDFS, Amazon s3)

  • Different file formats:
  • Text files
  • Json
  • Comma, tab separated values
  • Object files
  • Sequence files
  • Input /output formats
  • SPARKSQL for Structured data

Module-3: RDD’S

  • What is RDD
  • Why RDD?
  • RDD operations
  • Transformations
  • Actions
  • Lazy Evaluation
  • Basic RDD’s
  • Caching
  • Converting between RDD types
  • Spark Api supports Python, Java, Scala
  • Working with Key, value pairs
  • Create key, value pair RDD’s

1. Transformations on pair RDD’s

  • Aggregations
  • Grouping data
  • Joins
  • Sorting data

2. Actions on pair RDD’s

  • RDD’s partitioner
  • Operations from partitioning
  • Page Rank example

3. Advanced Spark operation

  • Aggregate
  • Fold
  • Map partitions
  • Glom
  • Accumulators
  • Broadcasters
  • Anatomy of a spark RDD
  • Splits
  • Localization
  • Serialization
  • Transformations Vs. Actions

Module-4: SPARK SQL

  • Spark sql in applications
  • Spark sql initialization
  • Spark sql basic query
  • Schema RDD’s
  • Caching
  • Load data from hive
  • Load data from json
  • Load data from RDD’s
  • Beeline
  • Long-lived tables and queries
  • Query hands-on
  • Spark sql UDF’s
  • Performance

Module-5: SPARK STREAMING

  • Streaming Architecture
  • Two types of Transformations
  •    1. Stateless Transformations
  •    2. Stateful Transformations
  • Streaming UI
  • Sources: Input
  • Core Sources
  • Additional Sources
  • Multiple Sources
  • Cluster Sizing

Fault Tolerance

  • Driver Fault Tolerance
  • Worker Fault Tolerance
  • Receiver Fault Tolerance
  • Operation 24/7
  • Performance
  • Garbage collection
  • Memory Usage

FAQ’S

What if I miss one (or) more class?

No need to worry about the classes you missed. We will definitely guide you by having optional classes or by having classes with other batches with the same topic you missed previous classes.

Who is my instructor?

IT professionals who have strong knowledge in technical know how to convey things with the real-time example. Even a layman could understand the concepts which given by our experts.

What are the modes of training offered for this course?

We offer this course in “Live Instructor-Led Online Training” mode. Through this way you won’t mess anything in your real-life schedule. You will be shared with live meeting access while your session starts.

What are the system requirements to work?

Minimum 2GB RAM and i3 processor is required

Can I attend a demo session?

You can get a sample class recording to ensure you are in right place. We ensure you will be getting complete worth of your money by assigning a best instructor in that technology.

How about group discounts (or) corporate training for our team?

We are absolutely loved to talk in-person about group training (or) corporate training. So, please get in touch with our team through “Quick Enquiry”, “Live Chat” or “Request Call-back” channels.

Where do Our Online learners and Trainer’s come from

We are providing online training, One-to-One training with the help of experts. Our learners and trainers are frequently coming from different countries like USA, India, UK, Australia, New Zealand, Canada and UAE. To specify in cities London, Bangalore, California, New York, Pune, Mumbai, Chennai, New Delhi, San Francisco, New Jersey, Texas, Florida, Kolkata, Gurgaon, Berlin and Hyderabad among many.

I have more queries?

If you want to know More Details about Online Training Please Contact us. Or you can share your quires through info@monstercourses.com. Estimated turnaround time will be 24 hours for mails.

Contact us

Enquiry Now..!!

Contact Details :

    Address: # 4110 Rainy Creek Ln, Cedar Park, TX, 78613, USA.

    Contact us: +1(772)777-1557

    Email ID: info@monstercourses.com

     

    Popular Courses We Offered :

     

    4110 Rainy Creek Ln, Cedar Park,

    TX USA, 78613.

    Phone: +1(772)777-1557

    Email : info@monstercourses.com

     

    The Training Classes what i have attended from MonsterCourses was quite beneficial.Good way of diving modules and covering important topics in each module. Overall the training from MonsterCourses was very good and useful to me.

    Vijay Naresh…

    Raju K, Monster Courses

    We are very much benefited from Business objects online training program. Handouts are very useful and very nicely given so that at-least by seeing the handouts we can practice and get knowledge. We have been taught many topics from this Training, nice to getting trained from “MonsterCourses

    Govardhan Bhaskar….

    Vijay Naresh, Monster Courses

    I felt OBIEE online training was very informative as compared to other online training providers. The faculty of MonsterCourses are very efficient in their subject and gave quality training. They covered each and every topic clearly elaborated them with examples.

    Vinay K…

    Govardhan Bhaskar, Monster Courses