Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exporter for Humio #3021

Closed
Xitric opened this issue Apr 8, 2021 · 0 comments
Closed

Exporter for Humio #3021

Xitric opened this issue Apr 8, 2021 · 0 comments

Comments

@Xitric
Copy link
Contributor

Xitric commented Apr 8, 2021

Is your feature request related to a problem? Please describe.
We wish to use the OpenTelemetry collector to export traces and logs to the log aggregation tool Humio.

Describe the solution you'd like
We wish to develop an exporter for the Humio log aggregation platform. Specifically, we wish to support traces and logs, but metrics can also be supported in the future.

Describe alternatives you've considered
We have investigated the options for exporting data to Humio from OpenTelemetry, and an exporter seems to be required.

Additional context
@em135 and I are working on this feature as part of our Master's Thesis. We have held meetings with multiple developers from Humio to discuss the details of such an exporter. Humio has agreed to let us develop the exporter as part of our thesis. Since we are not affiliated with Humio, we are contributing this exporter as our own work. Humio has expressed an interest to integrate with OpenTelemetry in the future, so we are just helping along.

tigrannajaryan pushed a commit that referenced this issue Apr 13, 2021
This is the first PR for the Humio exporter, containing readme, configuration, factory, and relevant tests.
The first series of PRs will focus on implementing exporting of traces, with logs to follow soon.

Apologies for the large PR, but I hope that the changes are sufficiently trivial.

**Link to tracking Issue:**
#3021

**Testing:**
- `config_test.go`: Tests that the configuration options can be correctly loaded, including defaults. Also tests configuration sanitization.
- `factory-test.go`: Tests that a factory only creates a new exporter (currently a stub) if provided with a valid configuration.

**Documentation:**
Added documentation for the purpose of the exporter and all its current configuration options. This includes Humio endpoints, ingest tokens, and storage options for Humio.

Also added examples of configuring the exporter at various degrees of detail.

Lastly, I added references to configuration options inherited from:
- [HTTP Client Configuration](https://github.com/open-telemetry/opentelemetry-collector/tree/main/config/confighttp#client-configuration)
- [TLS Configuration](https://github.com/open-telemetry/opentelemetry-collector/blob/main/config/configtls/README.md#tls-configuration-settings)
- [Queueing, Retry, and Timeout Configuration](https://github.com/open-telemetry/opentelemetry-collector/blob/main/exporter/exporterhelper/README.md#configuration)
This was referenced Apr 14, 2021
pmatyjasek-sumo pushed a commit to pmatyjasek-sumo/opentelemetry-collector-contrib that referenced this issue Apr 28, 2021
This is the first PR for the Humio exporter, containing readme, configuration, factory, and relevant tests.
The first series of PRs will focus on implementing exporting of traces, with logs to follow soon.

Apologies for the large PR, but I hope that the changes are sufficiently trivial.

**Link to tracking Issue:**
open-telemetry#3021

**Testing:**
- `config_test.go`: Tests that the configuration options can be correctly loaded, including defaults. Also tests configuration sanitization.
- `factory-test.go`: Tests that a factory only creates a new exporter (currently a stub) if provided with a valid configuration.

**Documentation:**
Added documentation for the purpose of the exporter and all its current configuration options. This includes Humio endpoints, ingest tokens, and storage options for Humio.

Also added examples of configuring the exporter at various degrees of detail.

Lastly, I added references to configuration options inherited from:
- [HTTP Client Configuration](https://github.com/open-telemetry/opentelemetry-collector/tree/main/config/confighttp#client-configuration)
- [TLS Configuration](https://github.com/open-telemetry/opentelemetry-collector/blob/main/config/configtls/README.md#tls-configuration-settings)
- [Queueing, Retry, and Timeout Configuration](https://github.com/open-telemetry/opentelemetry-collector/blob/main/exporter/exporterhelper/README.md#configuration)
alexperez52 referenced this issue in open-o11y/opentelemetry-collector-contrib Aug 18, 2021
mstumpfx pushed a commit to mstumpfx/opentelemetry-collector-contrib that referenced this issue Aug 31, 2021
This is the first PR for the Humio exporter, containing readme, configuration, factory, and relevant tests.
The first series of PRs will focus on implementing exporting of traces, with logs to follow soon.

Apologies for the large PR, but I hope that the changes are sufficiently trivial.

**Link to tracking Issue:**
open-telemetry#3021

**Testing:**
- `config_test.go`: Tests that the configuration options can be correctly loaded, including defaults. Also tests configuration sanitization.
- `factory-test.go`: Tests that a factory only creates a new exporter (currently a stub) if provided with a valid configuration.

**Documentation:**
Added documentation for the purpose of the exporter and all its current configuration options. This includes Humio endpoints, ingest tokens, and storage options for Humio.

Also added examples of configuring the exporter at various degrees of detail.

Lastly, I added references to configuration options inherited from:
- [HTTP Client Configuration](https://github.com/open-telemetry/opentelemetry-collector/tree/main/config/confighttp#client-configuration)
- [TLS Configuration](https://github.com/open-telemetry/opentelemetry-collector/blob/main/config/configtls/README.md#tls-configuration-settings)
- [Queueing, Retry, and Timeout Configuration](https://github.com/open-telemetry/opentelemetry-collector/blob/main/exporter/exporterhelper/README.md#configuration)
@alolita alolita closed this as completed Sep 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants