Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tier ETL architectural patterns
- Creating modular and reusable components
- Hybrid integration strategies across various systems
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and thread management
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Integrating scripting within transformations
- Building custom plugins
- Expanding PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integrations
- Interacting with big data platforms
- Advanced handling of files and APIs
Data Governance, Security, and Compliance
- Securing transformations and managing credentials
- Establishing data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Managing extensive job networks
- Designing error recovery and failover mechanisms
- Orchestrating across different environments
Repository, Version Control, and CI/CD
- Implementing enterprise repository strategies
- Integrating PDI with Git workflows
- Adopting continuous deployment patterns
Deployment, Monitoring, and Production Operations
- Promoting solutions across multiple environments
- Utilizing operational tools and dashboards
- Achieving end-to-end production readiness
Conclusion and Future Pathways
Requirements
- A foundational understanding of ETL pipelines and data modeling concepts
- Practical experience with intermediate-level PDI transformations
- Proficiency in SQL and scripting languages
Target Audience
- Senior Data Engineers
- ETL Architects
- Professionals responsible for managing complex data integration workloads
Testimonials (1)
It's a hands-on session.
