Module rdkafka::producer::base_producer
source · [−]Expand description
Low-level Kafka producers.
For more information about the producers provided in rdkafka, refer to the
producer
module documentation.
BaseProducer
The BaseProducer
is a low level Kafka producer designed to be as similar
as possible to the underlying C librdkafka producer, while maintaining a
safe Rust interface.
Production of messages is fully asynchronous. The librdkafka producer will take care of buffering requests together according to configuration, and to send them efficiently. Once a message has been produced, or the retry count reached, a callback function called delivery callback will be called.
The BaseProducer
requires a ProducerContext
which will be used to
specify the delivery callback and the
DeliveryOpaque
. The DeliveryOpaque
is
a user-defined type that the user can pass to the send
method of the
producer, and that the producer will then forward to the delivery callback
of the corresponding message. The DeliveryOpaque
is useful in case the
delivery callback requires additional information about the message (such as
message id for example).
Calling poll
To execute delivery callbacks the poll
method of the producer should be
called regularly. If poll
is not called, or not often enough, a
RDKafkaErrorCode::QueueFull
error will be returned.
ThreadedProducer
The ThreadedProducer
is a wrapper around the BaseProducer
which spawns a
thread dedicated to calling poll
on the producer at regular intervals, so
that the user doesn’t have to. The thread is started when the producer is
created, and it will be terminated once the producer goes out of scope.
A RDKafkaErrorCode::QueueFull
error can still be returned in case the
polling thread is not fast enough or Kafka is not able to receive data and
acknowledge messages quickly enough. If this error is returned, the caller
should wait and try again.
Re-exports
pub use crate::message::DeliveryResult;
Structs
Lowest level Kafka producer.
A record for the BaseProducer
and ThreadedProducer
.
A low-level Kafka producer with a separate thread for event handling.