Apache Kafka - 2022 Edition [.NET 6 Consumer and Producer, Docker containerized Kafka services]
#kafka #dotnet #csharp
I have done a couple of videos in 2018 for Kafka, but since then there have been a lot of improvements and changes in the Kafka echo system. And same is true for the Kafka client NuGet package.
Hence, I am creating a new series on Kafka with .NET 6 application, starting from explaining the basics of Kafka, to busing a distributed Microservices application using Kafka.
In this video, I will cover the basics of Kafka and a simple example of Producer and Consumer for Kafka topics.
The command used in the video to download the docker-compose file for Kafka and then start containers:
1. curl --silent --output docker-compose.yml raw.githubusercontent.com/con...
2. docker-compose up -d
Stay tuned for the next week's video, as I will cover building a real-life application using Kafka and ASP.NET 6.
My KZhead Channel: / dotnetcorecentral
My Blog WebSite: dotnetcorecentral.com/
My GitHub Repo: github.com/choudhurynirjhar
Thank you for putting out the time to create these videos. They are extremely helpful to get a brief overview of the technology.
@Son Tran, thanks for watching!
Thank you for supporting us in the Dev community with such valuable content!!
Thanks for watching
good job, can i ask you a question ? what if i want to access these environment variables (like bootstrap servers) in docker without implementing it in code
Awesome content bro
Thanks!
Can you publish to the same topic, messages from different object types? For instance, in the weather topic, we may want to publish a temperature object, a humidity object etc... And in the consumer, could we subscribe to the topic and only consume messages of the X object type? Without consuming all messages and checking for the type.
I have some concerns about docker file can you explain which Image is used for which part. I basically want to remove unwanted images from it.
Very good!
Thanks!
Amazing! :)
Thanks
Nirjhar excellent work
@George Zarogkikas, thanks for watching!
Thanks man
Thanks for watching!
Thanks!
Welcome!
Muy bueno
Thanks!
I got an error like docker-compose is not recognised by internal or external command. What to do now?
Do you have docker desktop running?
is it apache kafka (free) or the confluent paid licensed offer ?...
This is free apache Kafka I used here
is apache kafka different from confluent kafka?
Confluent kafka is apache kafka hosted by confluent
Hello I used your docker file but can not start Kafka
Same here.
Hi pro can i user kafka in angular
Yes you can, as long as its through an API
7:14 When you have 3 partitions and 5 consumers then 2 consumers will be idle! To make use of them you need to rebalance to 5 partitions.
Correct
Is Confluent free to use?
Kafka open source is free to use, but if you use Kafka in confluent cloud, they have a trial version, but based on usage you will have to pay.
Two consumers from the same consumer group will never consume from the same Kafka partition, by design.
Ohh for god's sake. Please rehearse well before recording. Too much of pauses in between sentences tests the patience of the listener. I hope you could take this criticism constructively. Otherwise, it's well put-together content. Keep it up.
I think he did a great job explaining these concepts. His pace was fine..those pauses were needed.. :) helps people process things
Agreed however just accumulate the content and follow step by step instructions. It's worth it because the example work. These are new people so they need a little support and motivation to improve.
Dear Karthik, with all due respect. I believe everyone is a learner here. No offense youTube gives us option for playback speed. Again No offense please
Why use Confluent ?