Get in Touch
 Duration 21 hours

Course Outline

Enterprise Architecture and Pipeline Design

  • Multi-layered ETL architectures
  • Creating modular and reusable components
  • Cross-system hybrid methodologies

Advanced Performance Engineering

  • Optimization at the step level
  • Strategies for parallelism and threading
  • Surveillance of high-load pipelines

Automation, Scripting, and Custom Extensions

  • Incorporating scripting within transformations
  • Creating bespoke plugins
  • Enhancing PDI capabilities using Java and JavaScript

Complex Data Processing and Integrations

  • Real-time and streaming integration capabilities
  • Interaction with big data platforms
  • Advanced handling of files and APIs

Data Governance, Security, and Compliance

  • Protecting transformations and credentials
  • Ensuring data lineage and traceability
  • Addressing regulatory and compliance requirements

Enterprise Orchestration and Scheduling

  • Oversight of extensive job networks
  • Designing error recovery and failover mechanisms
  • Orchestration at the environment level

Repository, Version Control, and CI/CD

  • Strategies for enterprise repositories
  • Integration of PDI with Git
  • Patterns for continuous deployment

Deployment, Monitoring, and Production Operations

  • Promoting solutions across various environments
  • Implementation of operational tooling and dashboards
  • Achieving comprehensive production readiness

Conclusion and Future Directions

Requirements

  • Familiarity with ETL pipelines and data modeling concepts
  • Proficiency with intermediate-level PDI transformations
  • Strong competencies in SQL and scripting

Target Audience

  • Senior data engineers
  • ETL architects
  • Specialists overseeing complex data integration operations

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories