Part 3: Kafka Architecture
Connector API - Sometimes kafka needs to be integrated with existing applications and systems. As an example, if we want to read a set of log files through kafka to process the data within those files using a stream processor, kafka provides the connector API to implement reusable components called connectors. The same connector can be used for any file-based integration with kafka.
Streaming API - The events stored in kafka sometimes needs to be processed in real-time for various purposes like transformation, correlation, aggregation, etc. These sort of functionalities can be applied through a stream processor which acts on a continuous stream of records. Kafka streaming API exposes a topic as a stream of events so that any other stream processing engine can consume that and do the processing.
Happy Learning !!!
0 Comments