Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layered ETL architectures
- Creating modular and reusable components
- Cross-system hybrid methodologies
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and threading
- Surveillance of high-load pipelines
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations
- Creating bespoke plugins
- Enhancing PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming integration capabilities
- Interaction with big data platforms
- Advanced handling of files and APIs
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Oversight of extensive job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories
- Integration of PDI with Git
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Promoting solutions across various environments
- Implementation of operational tooling and dashboards
- Achieving comprehensive production readiness
Conclusion and Future Directions
Requirements
- Familiarity with ETL pipelines and data modeling concepts
- Proficiency with intermediate-level PDI transformations
- Strong competencies in SQL and scripting
Target Audience
- Senior data engineers
- ETL architects
- Specialists overseeing complex data integration operations
Testimonials (1)
It's a hands-on session.