I presented a version of this talk at NDC Oslo in 2018. You can get the recording on the NDC Youtube channel.
Click here to access the slides for this presentation.
The slides are licensed under Creative Commons Attribution-ShareAlike.
Click here to access demo code for this presentation. This includes all of the console applications and Kafka scripts to work with topics.
To get the flight data we loaded and the airport data we used to enrich our data sets, check out the Data expo '09 contest's set of flight data, including the 2008 flight data and airports CSV file
The source code is licensed under the terms offered by the GPL.
At this point, I highly recommend using the Confluent .NET client for Kafka due to its official support. Nevertheless, I think it's valuable to have an idea of other Kafka libraries which are available, as until late 2016, there were several viable alternatives.