Configuring the Kafka backend (Self-Hosted)
Supported Signals:
string
: Protocol Version. Kafka protocol version.
2.0.0
string[]
: Brokers. The list of kafka brokers
["localhost:9092"]
boolean
: Resolve Canonical Bootstrap Servers Only. Whether to resolve then reverse-lookup broker IPs during startup.
False
string
: Client ID. The client ID to configure the Sarama Kafka client with. The client ID will be used for all produce requests.
sarama
string
: Topic. The name of the default kafka topic to export to (default = otlp_spans for traces, otlp_metrics for metrics, otlp_logs for logs).
string
: Topic from Attribute. Specify the resource attribute whose value should be used as the message’s topic.
string
: Encoding. The encoding of the traces sent to kafka.
otlp_proto
boolean
: Partition Traces by ID. Configures the exporter to include the trace ID as the message key in trace messages sent to kafka. Please note: this setting does not have any effect on Jaeger encoding exporters since Jaeger exporters include trace ID as the message key by default.
False
boolean
: Partition Metrics by Resource Attributes. Configures the exporter to include the hash of sorted resource attributes as the message partitioning key in metric messages sent to kafka.
False
boolean
: Partition Logs by Resource Attributes. Configures the exporter to include the hash of sorted resource attributes as the message partitioning key in log messages sent to kafka.
False
string
: Auth Method. The auth method to use.
none
string
: Username. The username to use.
string
: Password. The password to use.
boolean
: Metadata Full. Whether to maintain a full set of metadata. When disabled, the client does not make the initial request to broker at the startup.
False
string
: Metadata Max Retry. The number of retries to get metadata.
3
string
: Metadata Backoff Retry. How long to wait between metadata retries.
250ms
string
: Timeout. Is the timeout for every attempt to send data to the backend.
5s
boolean
: Enable Retry on Failure.
True
string
: Initial Interval. Time to wait after the first failure before retrying; ignored if enabled
is false
.
5s
string
: Max Interval. Is the upper bound on backoff; ignored if enabled
is false
.
30s
string
: Max Elapsed Time. Is the maximum amount of time spent trying to send a batch; ignored if enabled
is false
.
120s
string
: Producer Max Message Bytes. The maximum permitted size of a message in bytes.
1000000
string
: Producer Required Acks. Controls when a message is regarded as transmitted.
1
string
: Producer Compression. The compression used when producing messages to kafka.
none
string
: Producer Flush Max Messages. The maximum number of messages the producer will send in a single broker request.
0
topic_from_attribute
is configured, and the corresponding attribute is found on the ingested data, the value of this attribute is used.topic.WithTopic
function (from the github.com/open-telemetry/opentelemetry-collector-contrib/pkg/kafka/topic package), the value set in the context is used.Add Destination
, select Kafka
and follow the on-screen instructionskafka.yaml
)kubectl