Get in Touch

Course Outline

Enterprise Architecture and Pipeline Design

  • Multi-layer ETL architectures
  • Building modular, reusable components
  • Cross-system hybrid strategies

Advanced Performance Engineering

  • Step-level optimization
  • Parallelism and threading tactics
  • Monitoring pipelines under high load

Automation, Scripting, and Custom Extensions

  • Integrating scripts within transformations
  • Creating custom plugins
  • Expanding PDI capabilities via Java and JavaScript

Complex Data Processing and Integrations

  • Real-time and streaming integrations
  • Interacting with big data platforms
  • Sophisticated file and API handling

Data Governance, Security, and Compliance

  • Protecting transformations and credentials
  • Data lineage and traceability
  • Regulatory and compliance requirements

Enterprise Orchestration and Scheduling

  • Oversight of large job networks
  • Error recovery and failover mechanisms
  • Environment-level orchestration

Repository, Version Control, and CI/CD

  • Enterprise repository strategies
  • Integration of PDI with Git
  • Continuous deployment workflows

Deployment, Monitoring, and Production Operations

  • Transitioning solutions across environments
  • Operational tools and dashboards
  • End-to-end production readiness

Summary and Next Steps

Requirements

  • Comprehension of ETL pipelines and data modeling
  • Familiarity with intermediate-level PDI transformations
  • Proficiency in SQL and scripting

Target Audience

  • Senior data engineers
  • ETL architects
  • Professionals overseeing complex data integration workloads
 21 Hours

Testimonials (1)

Related Categories