Course Outline
Introduction to the Stratio Platform
- Overview of Stratio’s architecture and its core modules.
- The function of Rocket and Intelligence within the data lifecycle.
- Logging in and navigating the Stratio user interface.
Utilizing the Rocket Module
- Data ingestion and pipeline construction.
- Establishing connections to data sources and configuring transformations.
- Employing PySpark for preprocessing tasks within Rocket.
PySpark Fundamentals for Stratio Users
- PySpark data structures and core operations.
- Understanding looping constructs: for, while, and if/else applications.
- Writing and applying custom functions using the def keyword.
Advanced PySpark Implementation in Rocket
- Streaming ingestion and real-time transformations.
- Leveraging loops and functions in both batch and real-time scenarios.
- Best practices for optimizing performance in PySpark pipelines.
Exploring the Intelligence Module
- Overview of data modeling and analytical capabilities.
- Feature selection, transformation, and exploratory analysis.
- The role of PySpark in custom analytics and deriving insights.
Constructing Advanced Analytics Workflows
- Developing user-defined functions (UDFs) within Intelligence.
- Applying conditionals and loops to structure data logic.
- Practical applications: segmentation, aggregation, and predictive modeling.
Deployment and Team Collaboration
- Saving, exporting, and reusing established workflows.
- Collaborating with team members on the Stratio platform.
- Reviewing outputs and integrating results with downstream tools.
Summary and Path Forward
Requirements
- Proficiency in Python programming.
- Familiarity with data analytics or big data processing principles.
- Foundational understanding of Apache Spark and distributed computing concepts.
Target Audience
- Data engineers operating within Stratio-based ecosystems.
- Analysts or developers utilizing the Rocket and Intelligence modules.
- Technical teams in the process of migrating to PySpark workflows within Stratio.
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.
