4.11 Sending data to Kafka

Using API’s of librdkafka (C/C++ Kafka Library) the sender module creates a connection to remote Kafka cluster and sends data to remote Kafka cluster.

Sender module in MDS gets all the user configured Kafka properties from the MeasStrmConfig table and it considers all the properties while connecting and sending data to remote Kafka server. If sender module sends all the user enabled measurements data to remote Kafka within the user configured time interval and still if the module has some time left to complete the interval, it tries to send the unsent data to remote Kafka server which is stored in disk.