All in One Offer! | Access Unlimited Courses in any category starting at just $29. Offer Ends in:

Browse Library

  • Business Solutions
  • Become an Instructor
  • 0
    Shopping Cart

    Your Cart is empty. Keep shopping to find a course!

    Browse Courses
Get Unlimited Learning Access
$29
7 days left at this price!
30-Day Money-Back Guarantee

This plan includes

  • Instant access to 11,000+ online courses
  • Play & Pause Course Videos
  • HD Video Recorded Lectures
  • Learn on Mobile/PC/Tablet
  • Quizzes and Real Projects
  • Lifetime Course Certificate
  • Instructor Chat Support
  • Cancel Plan Anytime
Subscribe to Learnfly’s top courses
Get this course, plus 11,000+ of our top-rated courses for one year with Go Annually Plan.
$348 $244 a year Save 30%
7 days left at this price!
30-Day Money-Back Guarantee

This plan includes

  • Instant access to 11,000+ online courses
  • Play & Pause Course Videos
  • HD Video Recorded Lectures
  • Learn on Mobile/PC/Tablet
  • Quizzes and Real Projects
  • Lifetime Course Certificate
  • Instructor Chat Support
  • Cancel Plan Anytime
$29
$244
  • Apache spark in detail with focus on hands-on and the underlying concepts. Learners will get to know the ways to get the best performance from Spark in production and avoid the common pitfalls.

Apache Spark has turned out to be the most sought-after skill for any big data engineer. An evolution of MapReduce programming paradigm, Spark provides unified data processing from writing SQL to performing graph processing to implementing Machine Learning algorithms. It effectively uses cluster nodes and better memory management to spread the load across cluster of nodes to get faster results. Apache Spark drives the mission of data-driven-decision-making in thousands of organizations.

In order to fairly appreciate the benefits of the libraries of Apache Spark, it is essential to know the foundations right. This course aims exactly at that part. It starts from the beginner level and gradually explains all the complex concepts in an easy to reflect manner. It gives a profound description of the features and working of the framework through 5 different use cases with detailed hands on implementations. In fact, some hands-on sessions and solutions to the use-cases are explained in a full classroom mode with videos extending over 40 mins. After taking this course, you will gain the expertise on Spark Core and usage of further libraries like Spark SQLStructured StreamingSpark ML and GraphX will be much easier to visualize, implement and optimize.

  • We'll be using Python API in Spark Programming. However, we'll explain all the programs in details but fundamental knowledge of Python will be beneficial.
  • Learning Desire
  • Data engineers and developers who wish to leverage the fast analytics using Apache Spark in production environments.
  • Big Data Developers
View More...
  • Section 1 : Distributed Data Processing 2 Lectures 00:33:50

    • Lecture 1 :
    • Expectations from Data Processing Framework Preview
    • Lecture 2 :
    • Introduction to Map Reduce
  • Section 2 : Resources 1 Lectures

    • Lecture 1 :
    • Links to resources
  • Section 3 : Concepts of Apache Spark 3 Lectures 00:44:58

    • Lecture 1 :
    • Introduction to Spark
    • Lecture 2 :
    • Introduction to Resilient Distributed Dataset (RDD)
    • Lecture 3 :
    • Architecture of Spark
  • Section 4 : Starting HandsOn with Spark Applications 3 Lectures 00:49:14

    • Lecture 1 :
    • Downloading and Installing
    • Lecture 2 :
    • Our first Spark Program
    • Lecture 3 :
    • Our first exposure to data aggregation in Spark
  • Section 5 : Deep Dive into Spark Concepts 3 Lectures 01:00:46

    • Lecture 1 :
    • Deeper dive into our first Spark Program
    • Lecture 2 :
    • Partitioners
    • Lecture 3 :
    • Quiz
    • Quiz
  • Section 6 : Exploring operations on RDDs 5 Lectures 01:33:00

    • Lecture 1 :
    • Operations on RDDs without Aggregations
    • Lecture 2 :
    • Aggregations on RDD [Part 1]
    • Lecture 3 :
    • Aggregations on RDD [Part 2]
    • Lecture 4 :
    • Quiz
    • Quiz
    • Lecture 5 :
    • Joining RDDs
  • Section 7 : Advanced Concepts of Apache Spark 8 Lectures 04:00:18

    • Lecture 1 :
    • Broadcast Variables
    • Lecture 2 :
    • Hands On with Broadcast Variables | Analyzing Stock Data
    • Lecture 3 :
    • Caching
    • Lecture 4 :
    • Hands On with Caching | Analyzing Healthcare Dataset
    • Lecture 5 :
    • Hands On with Accumulators | Analyzing Log Data
    • Lecture 6 :
    • Hands On with combineByKey | Credit Card Transaction Analysis
    • Lecture 7 :
    • Hands On with Secondary Sort | Analyzing Car Loan Data
    • Lecture 8 :
    • Quiz
    • Quiz
  • Section 8 : Running Spark Application in a Cluster 1 Lectures 00:43:09

    • Lecture 1 :
    • Running Spark on a Cluster | New York Yellow Taxi Trip Data Analysis
  • Section 9 : Tuning Spark Applications 5 Lectures 01:13:44

    • Lecture 1 :
    • Deciding the right size for executor
    • Lecture 2 :
    • Exploring Dynamic Allocation
    • Lecture 3 :
    • Handling Skewed Data
    • Lecture 4 :
    • Further tips on optimising the performance
    • Lecture 5 :
    • Quiz
    • Quiz
  • How do i access the course after purchase?

    It's simple. When you sign up, you'll immediately have unlimited viewing of thousands of expert courses, paths to guide your learning, tools to measure your skills and hands-on resources like exercise files. There’s no limit on what you can learn and you can cancel at any time.
  • Are these video based online self-learning courses?

    Yes. All of the courses comes with online video based lectures created by certified instructors. Instructors have crafted these courses with a blend of high quality interactive videos, lectures, quizzes & real world projects to give you an indepth knowledge about the topic.
  • Can i play & pause the course as per my convenience?

    Yes absolutely & thats one of the advantage of self-paced courses. You can anytime pause or resume the course & come back & forth from one lecture to another lecture, play the videos mulitple times & so on.
  • How do i contact the instructor for any doubts or questions?

    Most of these courses have general questions & answers already covered within the course lectures. However, if you need any further help from the instructor, you can use the inbuilt Chat with Instructor option to send a message to an instructor & they will reply you within 24 hours. You can ask as many questions as you want.
  • Do i need a pc to access the course or can i do it on mobile & tablet as well?

    Brilliant question? Isn't it? You can access the courses on any device like PC, Mobile, Tablet & even on a smart tv. For mobile & a tablet you can download the Learnfly android or an iOS app. If mobile app is not available in your country, you can access the course directly by visting our website, its fully mobile friendly.
  • Do i get any certificate for the courses?

    Yes. Once you complete any course on our platform along with provided assessments by the instructor, you will be eligble to get certificate of course completion.
  • For how long can i access my course on the platform?

    You require an active subscription to access courses on our platform. If your subscription is active, you can access any course on our platform with no restrictions.
  • Is there any free trial?

    Currently, we do not offer any free trial.
  • Can i cancel anytime?

    Yes, you can cancel your subscription at any time. Your subscription will auto-renew until you cancel, but why would you want to?

155326 Course Views

2 Courses

  • Unmatched Variety and Value!
    Learnfly's monthly subscription offers unlimited access to a vast range of courses. Affordable pricing, compared to competitors, makes it the ultimate choice for continuous learning.
    Jessica M.

    4.7

    JM
  • Top-Notch Quality, Affordable Rates!
    High-quality courses with certified instructors make Learnfly stand out. The affordable pricing is a game-changer for those seeking premium education.
    Alex P.

    4.5

    AP
  • Certified Excellence Every Time!
    Learnfly's courses, taught by certified instructors, ensure top-notch learning experiences. The course completion certificates add significant value to one's skill set.
    Sarah R.

    4.3

    SR
  • Round-the-Clock Support!
    Learnfly goes the extra mile with 24/7 course support. Their dedication to helping students succeed is commendable.
    Ryan K.

    4.1

    RK
  • Learn Anywhere, Anytime!
    Whether on mobile, PC, or tablet, Learnfly's platform offers flexibility. Learning on the go has never been easier.
    Emily S.

    4.7

    ES
  • Job-Ready Skills!
    Learnfly's job-oriented courses equip learners with practical skills for the workplace. An investment in career growth!
    Jake M.

    4.2

    JM
  • Budget-Friendly Brilliance!
    Learnfly's pricing is a steal for the quality and variety of courses offered. Quality education without breaking the bank.
    Olivia T.

    4.5

    OT
  • Instructor Excellence Unleashed!
    Learn from the best with Learnfly's certified instructors. The platform ensures that knowledge is imparted by industry experts.
    Daniel L.

    4.0

    DL
  • Achievement Unlocked!
    Learnfly not only offers courses but also recognizes your efforts with course completion certificates. A sense of accomplishment with every course finished.
    Maya H.

    4.6

    MH
  • Learning Revolution!
    Learnfly's platform is a revolution in education. Access to unlimited courses at affordable rates is a game-changer.
    Ethan W.

    4.7

    EW
  • big-data-pipeline-applied-to-ufos

    Big Data Pipeline Applied to UFOs

    By : Eduardo Morelli

    Lectures 6 Beginner 0:16:47
  • git-and-github-version-control-the-complete-startup-guide

    Git and GitHub Version Control - Th...

    By : Abhilash Nelson

    Lectures 15 Beginner 1:34:6
  • statistics-for-data-scientists-and-data-analysts

    Statistics for Data Scientists and ...

    By : Phikolomzi Gugwana

    Lectures 31 Intermedite 0:36:49
  • big-data-and-hadoop

    Big Data and Hadoop

    By : Saheb Singh chaddha

    Lectures 26 Beginner 0:1:29
  • technical-writing-how-to-write-software-documentation-using-dita-xml

    Technical Writing: How to Write Sof...

    By : Jordan Stanchev

    Lectures 21 Beginner 3:35:45
  • apache-nifi-the-complete-guide-part-1

    Apache NiFi - The Complete Guide (P...

    By : Manoj G T

    Lectures 19 Beginner 1:23:18

Students learning on Learnfly works with Fortune 500 companies around the globe.

Sign Up & Start Learning
By signing up, you agree to our Terms of Use and Privacy Policy
Reset Password
Enter your email address and we'll send you a link to reset your password.