[exporter/elasticsearch] Support Persistent queue for Elasticsearch exporter #19445

JaredTan95 · 2023-03-10T13:46:58Z

Description:
close #19424

Link to tracking Issue: <#19424>

Testing:

Documentation:

runforesight · 2023-03-10T13:48:18Z

Foresight Summary

Major Impacts

build-and-test-windows duration(5 seconds) has decreased 43 minutes 24 seconds compared to main branch avg(43 minutes 29 seconds).

View More Details

⭕ build-and-test-windows workflow has finished in 5 seconds (43 minutes 26 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
windows-unittest-matrix	- 🔗	N/A	See Details
windows-unittest	- 🔗	N/A	See Details

✅ telemetrygen workflow has finished in 1 minute 16 seconds (49 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
build-dev	- 🔗	N/A	See Details
publish-latest	- 🔗	N/A	See Details
publish-stable	- 🔗	N/A	See Details

✅ check-links workflow has finished in 1 minute 33 seconds and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
changed files	- 🔗	N/A	See Details
check-links	- 🔗	N/A	See Details

✅ changelog workflow has finished in 2 minutes 12 seconds and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
changelog	- 🔗	N/A	See Details

✅ build-and-test workflow has finished in 34 minutes 1 second (31 minutes 13 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
unittest-matrix (1.20, connector)	- 🔗	✅ 113 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, connector)	- 🔗	✅ 113 ❌ 0 ⏭ 0 🔗	See Details
correctness-metrics	- 🔗	✅ 2 ❌ 0 ⏭ 0 🔗	See Details
correctness-traces	- 🔗	✅ 17 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, extension)	- 🔗	✅ 538 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.20, internal)	- 🔗	✅ 583 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.20, extension)	- 🔗	✅ 538 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, internal)	- 🔗	✅ 583 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, processor)	- 🔗	✅ 1545 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.20, processor)	- 🔗	✅ 1545 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, receiver-0)	- 🔗	✅ 2580 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.20, receiver-0)	- 🔗	✅ 2580 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.20, exporter)	- 🔗	✅ 2484 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, receiver-1)	- 🔗	✅ 1940 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, exporter)	- 🔗	✅ 2484 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.20, other)	- 🔗	✅ 4728 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.19, other)	- 🔗	✅ 4728 ❌ 0 ⏭ 0 🔗	See Details
unittest-matrix (1.20, receiver-1)	- 🔗	✅ 1940 ❌ 0 ⏭ 0 🔗	See Details
integration-tests	- 🔗	✅ 55 ❌ 0 ⏭ 0 🔗	See Details
setup-environment	- 🔗	N/A	See Details
check-codeowners	- 🔗	N/A	See Details
check-collector-module-version	- 🔗	N/A	See Details
checks	- 🔗	N/A	See Details
lint-matrix (receiver-0)	- 🔗	N/A	See Details
lint-matrix (receiver-1)	- 🔗	N/A	See Details
lint-matrix (processor)	- 🔗	N/A	See Details
lint-matrix (exporter)	- 🔗	N/A	See Details
lint-matrix (extension)	- 🔗	N/A	See Details
lint-matrix (connector)	- 🔗	N/A	See Details
lint-matrix (internal)	- 🔗	N/A	See Details
lint-matrix (other)	- 🔗	N/A	See Details
build-examples	- 🔗	N/A	See Details
lint	- 🔗	N/A	See Details
unittest (1.20)	- 🔗	N/A	See Details
unittest (1.19)	- 🔗	N/A	See Details
cross-compile (darwin, amd64)	- 🔗	N/A	See Details
cross-compile (darwin, arm64)	- 🔗	N/A	See Details
cross-compile (linux, 386)	- 🔗	N/A	See Details
cross-compile (linux, amd64)	- 🔗	N/A	See Details
cross-compile (linux, arm)	- 🔗	N/A	See Details
cross-compile (linux, arm64)	- 🔗	N/A	See Details
cross-compile (linux, ppc64le)	- 🔗	N/A	See Details
cross-compile (windows, 386)	- 🔗	N/A	See Details
cross-compile (windows, amd64)	- 🔗	N/A	See Details
build-package (deb)	- 🔗	N/A	See Details
build-package (rpm)	- 🔗	N/A	See Details
windows-msi	- 🔗	N/A	See Details
publish-dev	- 🔗	N/A	See Details
publish-check	- 🔗	N/A	See Details
publish-stable	- 🔗	N/A	See Details

✅ prometheus-compliance-tests workflow has finished in 3 minutes 13 seconds (4 minutes 22 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
prometheus-compliance-tests	- 🔗	✅ 21 ❌ 0 ⏭ 0 🔗	See Details

✅ load-tests workflow has finished in 7 minutes 18 seconds (6 minutes less than `main` branch avg.) and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
loadtest (TestIdleMode)	- 🔗	✅ 1 ❌ 0 ⏭ 0 🔗	See Details
loadtest (TestTraceNoBackend10kSPS\|TestTrace1kSPSWithAttrs)	- 🔗	✅ 8 ❌ 0 ⏭ 0 🔗	See Details
loadtest (TestTraceAttributesProcessor)	- 🔗	✅ 3 ❌ 0 ⏭ 0 🔗	See Details
loadtest (TestTraceBallast1kSPSWithAttrs\|TestTraceBallast1kSPSAddAttrs)	- 🔗	✅ 10 ❌ 0 ⏭ 0 🔗	See Details
loadtest (TestMetric10kDPS\|TestMetricsFromFile)	- 🔗	✅ 6 ❌ 0 ⏭ 0 🔗	See Details
loadtest (TestMetricResourceProcessor\|TestTrace10kSPS)	- 🔗	✅ 12 ❌ 0 ⏭ 0 🔗	See Details
loadtest (TestBallastMemory\|TestLog10kDPS)	- 🔗	✅ 18 ❌ 0 ⏭ 0 🔗	See Details
setup-environment	- 🔗	N/A	See Details

✅ e2e-tests workflow has finished in 14 minutes 20 seconds and finished at 11th Mar, 2023.

Job	Failed Steps	Tests
kubernetes-test (v1.26.0)	- 🔗	N/A	See Details
kubernetes-test (v1.25.3)	- 🔗	N/A	See Details
kubernetes-test (v1.24.7)	- 🔗	N/A	See Details
kubernetes-test (v1.23.13)	- 🔗	N/A	See Details

🔎 See details on Foresight

^{*You can configure Foresight comments in your organization settings page.}

raghu999

LGTM. Thanks for the quick turn around.

exporter/elasticsearchexporter/config.go

exporter/elasticsearchexporter/config_test.go

Signed-off-by: Jared Tan <[email protected]>

…xporter (open-telemetry#19445) Support Persistent queue for Elasticsearch exporter Signed-off-by: Jared Tan <[email protected]>

JaredTan95 requested a review from a team as a code owner March 10, 2023 13:46

JaredTan95 requested a review from TylerHelmuth March 10, 2023 13:46

github-actions bot assigned jpkrohling Mar 10, 2023

github-actions bot added the exporter/elasticsearch label Mar 10, 2023

JaredTan95 force-pushed the pers_que branch from 364270b to 395cc59 Compare March 10, 2023 14:05

raghu999 approved these changes Mar 10, 2023

View reviewed changes

atoulme reviewed Mar 10, 2023

View reviewed changes

exporter/elasticsearchexporter/config.go Show resolved Hide resolved

atoulme reviewed Mar 10, 2023

View reviewed changes

exporter/elasticsearchexporter/config_test.go Show resolved Hide resolved

Support Persistent queue for Elasticsearch exporter

531fd3e

Signed-off-by: Jared Tan <[email protected]>

JaredTan95 force-pushed the pers_que branch from 395cc59 to 531fd3e Compare March 11, 2023 03:23

JaredTan95 requested review from atoulme and removed request for TylerHelmuth March 13, 2023 13:33

atoulme approved these changes Mar 13, 2023

View reviewed changes

jpkrohling approved these changes Mar 27, 2023

View reviewed changes

jpkrohling merged commit ef5bfc7 into open-telemetry:main Mar 27, 2023

github-actions bot added this to the next release milestone Mar 27, 2023

JaredTan95 deleted the pers_que branch March 28, 2023 01:11

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[exporter/elasticsearch] Support Persistent queue for Elasticsearch exporter #19445

[exporter/elasticsearch] Support Persistent queue for Elasticsearch exporter #19445

JaredTan95 commented Mar 10, 2023

runforesight bot commented Mar 10, 2023 •

edited

Loading

`build-and-test-windows` duration(5 seconds) has decreased 43 minutes 24 seconds compared to main branch avg(43 minutes 29 seconds).

⭕ build-and-test-windows workflow has finished in 5 seconds (43 minutes 26 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ telemetrygen workflow has finished in 1 minute 16 seconds (49 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ check-links workflow has finished in 1 minute 33 seconds and finished at 11th Mar, 2023.

✅ changelog workflow has finished in 2 minutes 12 seconds and finished at 11th Mar, 2023.

✅ build-and-test workflow has finished in 34 minutes 1 second (31 minutes 13 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ prometheus-compliance-tests workflow has finished in 3 minutes 13 seconds (4 minutes 22 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ load-tests workflow has finished in 7 minutes 18 seconds (6 minutes less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ e2e-tests workflow has finished in 14 minutes 20 seconds and finished at 11th Mar, 2023.

raghu999 left a comment •

edited

Loading

[exporter/elasticsearch] Support Persistent queue for Elasticsearch exporter #19445

[exporter/elasticsearch] Support Persistent queue for Elasticsearch exporter #19445

Conversation

JaredTan95 commented Mar 10, 2023

runforesight bot commented Mar 10, 2023 • edited Loading

Foresight Summary

build-and-test-windows duration(5 seconds) has decreased 43 minutes 24 seconds compared to main branch avg(43 minutes 29 seconds).

⭕ build-and-test-windows workflow has finished in 5 seconds (43 minutes 26 seconds less than main branch avg.) and finished at 11th Mar, 2023.

✅ telemetrygen workflow has finished in 1 minute 16 seconds (49 seconds less than main branch avg.) and finished at 11th Mar, 2023.

✅ check-links workflow has finished in 1 minute 33 seconds and finished at 11th Mar, 2023.

✅ changelog workflow has finished in 2 minutes 12 seconds and finished at 11th Mar, 2023.

✅ build-and-test workflow has finished in 34 minutes 1 second (31 minutes 13 seconds less than main branch avg.) and finished at 11th Mar, 2023.

✅ prometheus-compliance-tests workflow has finished in 3 minutes 13 seconds (4 minutes 22 seconds less than main branch avg.) and finished at 11th Mar, 2023.

✅ load-tests workflow has finished in 7 minutes 18 seconds (6 minutes less than main branch avg.) and finished at 11th Mar, 2023.

✅ e2e-tests workflow has finished in 14 minutes 20 seconds and finished at 11th Mar, 2023.

raghu999 left a comment • edited Loading

Choose a reason for hiding this comment

runforesight bot commented Mar 10, 2023 •

edited

Loading

`build-and-test-windows` duration(5 seconds) has decreased 43 minutes 24 seconds compared to main branch avg(43 minutes 29 seconds).

⭕ build-and-test-windows workflow has finished in 5 seconds (43 minutes 26 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ telemetrygen workflow has finished in 1 minute 16 seconds (49 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ build-and-test workflow has finished in 34 minutes 1 second (31 minutes 13 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ prometheus-compliance-tests workflow has finished in 3 minutes 13 seconds (4 minutes 22 seconds less than `main` branch avg.) and finished at 11th Mar, 2023.

✅ load-tests workflow has finished in 7 minutes 18 seconds (6 minutes less than `main` branch avg.) and finished at 11th Mar, 2023.

raghu999 left a comment •

edited

Loading