KSSOURCE function creates a Kafka Streams Source node and adds it to a Kafka Streams topology.
The source node is defined using a map with the following keys:
|Name of the node. Must be unique within the topology.|
|Optional macro used to extract the record timestamp. This macro will be called with a map containing the record details and is expect to return a |
|Optional macro used to deserialize a record key. If unset, the default key deserializer will be used.|
|Optional macro used to deserialize a record value. If unset, the default value deserializer will be used.|
|Regular expression identifying the topics the source will consume.|
|Optional auto offset reset policy to use if no committed offsets are found, |
Deserializers are called with a parameter map containing keys
data associated with the record topic and byte array to deserialize.
The record details passed to
tsextractor are contained in a map with the following keys:
|The current record timestamp.|
|The type of timestamp, |
|Name of topic from which the record was consumed.|
|Offset of the record.|
|Partition of the record.|
|The highest extracted valid timestamp of the current record's partition˙ (could be -1 if unknown).|
|Map of record headers, key is a |
tsextractor macro is expected to return a timestamp expressed in milliseconds since the Unix Epoch.