DEV Community

Cover image for Learn Apache Kafka! (Best Courses & Tutorials 2020)
Devansh Agarwal for Coursesity

Posted on • Updated on

Learn Apache Kafka! (Best Courses & Tutorials 2020)

Apache Kafka has become the leading distributed data streaming enterprise big data technology. Kafka is used in production by over 33% of the Fortune 500 companies such as Netflix, Airbnb, Uber, Walmart, and LinkedIn. Apache Kafka is a skill in high demand and there are not enough people to fulfill all the open positions.

In today's enterprises, working with large amounts of data is no longer limited to internet-scale companies - every IT professional must be prepared with solutions to capture, maintain, and move terabytes of data reliably and at blistering speeds. Apache Kafka was designed to address large-scale, data movement problems and has enabled thousands of companies large and small to achieve successes not otherwise achievable with existing messaging systems.

Thus, considering the high demand and inappropriate supply, Apache Kafka is indeed a must-learn skill that you should definitely learn if you want to stand out from the crowd.

I have curated a list of Best Apache Kafka Courses for your reference below:

  1. Apache Kafka Course for Beginners: Learn Kafka Online

  2. Getting Started with Apache Kafka

  3. Learn Apache Kafka for Beginners Online Class

  4. Apache Kafka for Beginners - Second Edition[Updated Mar2020]

  5. Designing Event-driven Applications Using Apache Kafka Ecosystem

  6. Apache Kafka - Real-time Stream Processing (Master Class)

1. Apache Kafka Course for Beginners: Learn Kafka Online

Learn Apache Kafka 2.0 Ecosystem, Core Concepts, Real World Java Producers/Consumers & Big Data Architecture

Course rating: 4.7 out of 5.0 ( 15,874 Ratings total)

In this course, you will :

  • Understand Apache Kafka Ecosystem, Architecture, Core Concepts and Operations.
  • Master Concepts such as Topics, Partitions, Brokers, Producers, Consumers.
  • Start a personal Kafka development environment.
  • Learn major CLIs: kafka-topics, kafka-console-producer, kafka-console-consumer, kafka-consumer-groups, kafka-configs.
  • Create your Producers and Consumers in Java to interact with Kafka.
  • Program a Real World Twitter Producer & ElasticSearch Consumer.
  • Extended APIs Overview (Kafka Connect, Kafka Streams), Case Studies and Big Data Architecture.
  • Practice and Understand Log Compaction.
  • The Apache Kafka Ecosystem Architecture
  • The Kafka Core Concepts: Topics, Partitions, Brokers, Replicas, Producers, Consumers, and more!
  • Launch your own Kafka cluster in no time using native Kafka binaries – Windows / MacOS X / Linux
  • Learn and Practice using the Kafka Command Line Interface (CLI)
  • Code Producer and Consumers using the Java API
  • Real world project using Twitter as a source of data for a producer and ElasticSearch as a sink for our consumer
  • Overview of Advanced APIs (Kafka Connect, Kafka Streams)
  • Real World Case Studies and Big Use cases
  • Overview of Advanced Kafka for Administrators
  • Advanced Topic Configurations

You can take Apache Kafka Course for Beginners: Learn Kafka Online Certificate Course on Udemy .

2. Getting Started with Apache Kafka

This course will introduce you to Apache Kafka and provide a thorough tour of its architecture so you can start building your next enterprise system with it.

Course rating: 5.0 out of 5.0 ( 552 Ratings total)

In this course, you will :

  • Get a thorough understanding of Apache Kafka's architecture and how it has adopted proven distributed systems design principles that enable it to scale and perform reliably.
  • Then, you will breakdown this architecture into individual components and learn about each in great detail.
  • Finally, you will use the components in action with common scenarios and walkthough how Apache Kafka solutions can be developed in Java.
  • By the end of the course, you will have an understanding and appreciation for why Apache Kafka is taking the industry by storm but most importantly, you will come away with confidence and knowledge to build your next generation big data solutions with Apache Kafka.

You can take Getting Started with Apache Kafka Certificate Course on Pluralsight .

3. Learn Apache Kafka for Beginners Online Class

Learn the Apache Kafka basics. Learn how to use this enterprise-scale data streaming technology to read and write data from multiple sources—without managing multiple integrations.

Course rating: 28,518 total enrollments

In this course you will;

  • Apache Kafka basics
  • Kafka theory and architecture
  • Setting up Kafka to run on Mac, Linux, and Windows
  • Working with the Kafka CLI
  • Creating and configuring topics
  • Writing Kafka producers and consumers in Java
  • Writing and configuring a Twitter producer
  • Writing a Kafka consumer for ElasticSearch
  • Working with Kafka APIs: Kafka Connect, Streams, and Schema Registry
  • Kafka case studies
  • Kafka monitoring and security
  • Advanced Kafka configuration
  • Starting Kafka using binaries, Docker, and remote machines

You can take Learn Apache Kafka for Beginners Online Class Certificate Course on Linkedin .

4. Apache Kafka for Beginners - Second Edition[Updated Mar2020]

Deep dive in to Apache Kafka concepts and learn to build Kafka producers/consumers using Java.

Course rating: 4.1 out of 5.0 ( 670 Ratings total)

In this course, you will :

  • Understand all the Kafka concepts and Kafka core internals..
  • Learn Kafka internals through practice.
  • Build Kafka Producer applications using Java.
  • Learn the Kafka Producer Techniques for reliable data delivery.
  • Build Kafka Consumer applications using Java.
  • Advance Kafka Consumer Techniques to handle duplicate processing of records.
  • Consumer Rebalance and different techniques to handle them.
  • Consumer techniques to seek to a specific offset.
  • Learn to build Custom Serializer and Deserializer in Kafka.
  • By the end of the course you will have a complete understanding of Apache Kafka and build Kafka consumer applications using Java.
  • Learn about the Topics and Partitions in Kafka
  • Setup a Local Kafka Cluster with Multiple Brokers
  • Producer/Consumer messages in the Kafka Cluster
  • Learn about Consumer Offsets and Consumer Groups
  • Commit Log and Retention Policy
  • Learn about Kafka Load Distribution and Fault Tolerance and Robustness
  • Setting up the base-project for Producer
  • Understand how the producer API works
  • Produce messages to the Kafka topic using the Synchronous/Asynchronous approach
  • Understand how Kafka producer API works behind the scenes and explore some of the producer API Configurations
  • Configuring the acks and min.insync.replicas for guaranteed message delivery
  • Override the retries and retry-back-off-ms value
  • Setting up the base-project for Consumers
  • Consuming Messages using Consumer API - poll() loop
  • Build Kafka Consumer using the Consumer API
  • auto.offset.reset - earliest vs latest
  • Scaling the Consumer using Consumer Groups
  • Consumer Rebalance
  • Consumer Rebalance & max-poll-interval-ms
  • Committing Offsets - Default Offset Commit Strategy
  • Manually Committing Offsets and committing Offsets Synchronously - using commitSync()
  • Committing Offsets Asynchronously - using commitAsync()
  • Committing Specific Offsets - using CommitSync()

You can take Apache Kafka for Beginners - Second Edition[Updated Mar2020] Certificate Course on Udemy .

5. Designing Event-driven Applications Using Apache Kafka Ecosystem

Apache Kafka has become one of the most popular tools available when it comes to enterprise messaging and streaming. In this course, you will learn the basics of creating an event-driven system using Apache Kafka and the ecosystem around it.

Course rating: 4.5 out of 5.0 ( 53 Ratings total)

In this course, you will :

  • Gain the ability to design a real-time event-driven system.
  • First, you will learn the basics of event-driven systems and how to get into the mindset of creating one.
  • Next, you will discover Apache Kafka and several tools for integrating with it to make the process even smoother.
  • Finally, you will explore how to think the “streaming” way by processing data as it arrives in your system.
  • When you are finished with this course, you will have the skills and knowledge of Apache Kafka and the ecosystem around it needed to design an event-driven system.

You can take Designing Event-driven Applications Using Apache Kafka Ecosystem Certificate Course on Pluralsight .

6. Apache Kafka - Real-time Stream Processing (Master Class)

Processing Real-time Streams using Apache Kafka and Kafka Streams API - Start as Beginner to Finish as PRO

Course rating: 4.6 out of 5.0 ( 423 Ratings total)

In this course, you will :

  • Apache Kafka Foundation and Kafka Architecture.
  • Creating Streams using Kafka Producer APIs.
  • Designing, Developing and Testing Real-time Stream Processing Applications using Kafka Streams Library.
  • Kafka Streams Architecture, Streams DSL, Processor API and Exactly Once Processing in Apache Kafka.
  • Auto-generating Java Objects from JSON Schema definition, Serializing, Deserializing and working with JSON messages without Schema Registry..
  • Auto-generating Java Objects from AVRO Schema definition, Serializing, Deserializing and working with AVRO messages using Confluent Schema Registry..
  • Unit Testing and Integration Testing your Kafka Streams Application..
  • Supporting Microservices architecture and implementing Kafka Streams Interactive Query.

You can take Apache Kafka - Real-time Stream Processing (Master Class) Certificate Course on Udemy .


Glad to see, that you have made it till the end. If this article added some value to your learning or if you liked it then like, upvote and share it in your network. In case you want to explore more, you can take the Free Apache Kafka Courses
In case you liked this article, you can also visit the following posts of mine;

Also, I would love to hear any feedback and review from you. Please tell me what you liked in the comment section below. Happy Learning!✨

Disclosure: This post includes affiliate links; the client may receive compensation if you purchase products or services from the different links provided in this article.

Top comments (1)

Collapse
 
ekoutanov profile image
Emil Koutanov

How about Effective Kafka. Would love to see that listed too :)