Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Introduction:
- Apache Spark within the Hadoop Ecosystem
- Brief overview of Python and Scala
Foundational Concepts (Theory):
- Architecture
- Resilient Distributed Datasets (RDDs)
- Transformations and Actions
- Stages, Tasks, and Dependencies
Hands-on Workshop: Mastering the Basics in the Databricks Environment
- Exercises utilizing the RDD API
- Core action and transformation functions
- PairRDDs
- Join operations
- Caching strategies
- Exercises utilizing the DataFrame API
- SparkSQL
- DataFrame operations: select, filter, group, sort
- User-Defined Functions (UDFs)
- Exploration of the Dataset API
- Streaming
Hands-on Workshop: Deployment in the AWS Environment
- Fundamentals of AWS Glue
- Comparing AWS EMR and AWS Glue
- Practical job examples in both environments
- Analysis of advantages and disadvantages
Additional Content:
- Introduction to Apache Airflow orchestration
Requirements
Programming skills (preferably in Python and Scala)
Foundational knowledge of SQL
21 Hours
Testimonials (3)
Having hands on session / assignments
Poornima Chenthamarakshan - Intelligent Medical Objects
Course - Apache Spark in the Cloud
1. Right balance between high level concepts and technical details. 2. Andras is very knowledgeable about his teaching. 3. Exercise
Steven Wu - Intelligent Medical Objects
Course - Apache Spark in the Cloud
Get to learn spark streaming , databricks and aws redshift