Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Module 1: Understanding the Architecture and Configuration of Confluent Apache Kafka Clusters
- The role of Kafka in contemporary data pipelines
- Distinguishing between Apache Kafka and Confluent Kafka
- Essential components: producers, consumers, brokers, topics, and partitions
- Kafka cluster deployment strategies and scaling considerations
Module 2: Configuring Zookeeper Quorums
- Overview of Zookeeper
- The function of Zookeeper within a Kafka cluster
- Determining Zookeeper Quorum size
- Zookeeper setup and configuration
- Establishing SSH connections on servers
- Practical exercise: Configuring Zookeeper (both as a team and as a service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical exercise: Setting up Zookeeper Quorums
- Understanding the Zookeeper internal file system
- Key performance factors influencing Zookeeper
- Demonstrating management tools for Zookeeper and Zoonavigator
Module 3: Configuring Kafka Clusters
- Fundamental Kafka concepts
- Core Kafka configuration settings
- Practical exercise: Configuring Kafka brokers
- Practical exercise: Executing standard Kafka commands
- Practical exercise: Setting up a Kafka Multi-Broker Cluster
- Practical exercise: Testing Kafka cluster stability
- Verifying connectivity to the Kafka cluster
- Advertised.listeners configuration: A critical setting explained
- Topic-level configurations
- Settings for downloading and ingesting messages into topics
- Practical exercise: Demonstrating Kafka resilience
- Kafka performance optimization: I/O operations
- Kafka performance optimization: Network (RED)
- Kafka performance optimization: RAM usage
- Kafka performance optimization: CPU load
- Kafka performance optimization: Operating System (OS) interactions
- Kafka performance optimization: Other contributing factors
- Practical exercise: Modifying Kafka broker configurations
Module 4: Advanced Kafka Configurations
- Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
- Sending and receiving messages via CLI, Java, and the Spring framework
- Monitoring metrics using tools such as Confluent Control Center and Elasticsearch
- Managing log files and offsets
- Implementing high availability and disaster recovery mechanisms
- Achieving high availability through data replication
- Optimizing producer and consumer performance
- Formulating disaster recovery strategies
- Controlling failover processes and data recovery
- Connector configuration best practices
- Implementing Kafka Connect
- Exploring Kafka security features
Summary and Recommended Next Steps
Requirements
- A working knowledge of distributed systems and messaging principles
- Proficiency with the Linux command line interface
- A foundational understanding of networking and system administration tasks
Target Audience
- System administrators
- DevOps engineers
- Platform and infrastructure teams
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
