Skip to content

Latest commit

 

History

History

elasticsearchexporter

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
internal/objmodel
internal/objmodel
 
 
testdata
testdata
 
 
Makefile
Makefile
 
 
README.md
README.md
 
 
config.go
config.go
 
 
config_test.go
config_test.go
 
 
exporter.go
exporter.go
 
 
exporter_test.go
exporter_test.go
 
 
factory.go
factory.go
 
 
factory_test.go
factory_test.go
 
 
go.mod
go.mod
 
 
go.sum
go.sum
 
 
model.go
model.go
 
 
utils_test.go
utils_test.go
 
 

README.md

Elasticsearch Exporter

Status
Stability beta
Supported pipeline types logs
Distributions contrib

This exporter supports sending OpenTelemetry logs to Elasticsearch.

Configuration options

  • endpoints: List of Elasticsearch URLs. If endpoints and cloudid is missing, the ELASTICSEARCH_URL environment variable will be used.
  • cloudid (optional): ID of the Elastic Cloud Cluster to publish events to. The cloudid can be used instead of endpoints.
  • num_workers (optional): Number of workers publishing bulk requests concurrently.
  • index: The index or datastream name to publish events to. The default value is logs-generic-default.
  • pipeline (optional): Optional Ingest Node pipeline ID used for processing documents published by the exporter.
  • flush: Event bulk buffer flush settings
    • bytes (default=5242880): Write buffer flush limit.
    • interval (default=30s): Write buffer time limit.
  • retry: Event retry settings
    • enabled (default=true): Enable/Disable event retry on error. Retry support is enabled by default.
    • max_requests (default=3): Number of HTTP request retries.
    • initial_interval (default=100ms): Initial waiting time if a HTTP request failed.
    • max_interval (default=1m): Max waiting time if a HTTP request failed.
  • mapping: Events are encoded to JSON. The mapping allows users to configure additional mapping rules.
    • mode (default=ecs): The fields naming mode. valid modes are:
    • fields (optional): Configure additional fields mappings.
    • file (optional): Read additional field mappings from the provided YAML file.
    • dedup (default=true): Try to find and remove duplicate fields/attributes from events before publishing to Elasticsearch. Some structured logging libraries can produce duplicate fields (for example zap). Elasticsearch will reject documents that have duplicate fields.
    • dedot (default=true): When enabled attributes with . will be split into proper json objects.

HTTP settings

  • read_buffer_size (default=0): Read buffer size.
  • write_buffer_size (default=0): Write buffer size used when.
  • timeout (default=90s): HTTP request time limit.
  • headers (optional): Headers to be send with each HTTP request.

Security and Authentication settings

  • user (optional): Username used for HTTP Basic Authentication.
  • password (optional): Password used for HTTP Basic Authentication.
  • api_key (optional): Authorization API Key.

TLS settings

  • ca_file (optional): Root Certificate Authority (CA) certificate, for verifying the server's identity, if TLS is enabled.
  • cert_file (optional): Client TLS certificate.
  • key_file (optional): Client TLS key.
  • insecure (optional): Disable verification of the server's identity, if TLS is enabled.

Node Discovery

The Elasticsearch Exporter will check Elasticsearch regularly for available nodes and updates the list of hosts if discovery is enabled. Newly discovered nodes will automatically be used for load balancing.

  • discover:
    • on_start (optional): If enabled the exporter queries Elasticsearch for all known nodes in the cluster on startup.
    • interval (optional): Interval to update the list of Elasticsearch nodes.

Example

exporters:
  elasticsearch:
    endpoints:
    - "https://localhost:9200"