reports.resultDir doesn't work

[terjokhin]

Hello.

I'm trying to config offline reports for my project, and I decided to go with separate reportDir for each kind of bench. Here is some obstacle that I have to face. Scalameter isn't using directory from reports.resultDir parameter of config section rather than default one (target/benchmarks).

Here is an example project https://github.com/daron666/scala_meter_result_dir_nor_working

I've configured scalameter to use target/bench instead of target/banchmarks, but offline report is being saved into default directory anyway.

[ghost]

The resultDir property is only considered at the top-level. You would need to separate your benchmarks into multiple Bench classes, each using a different resultDir.

[terjokhin]

@cantor-chron That how it's done, separate classes with with separate resultDir, despite this all tests are being generated into default directory.

[glasperfan]

Also experiencing this issue, but it seems to be by design. According to the 0.7+ documentation:

The reports.resultDir is a global test parameter, so it can only be set when you start the tests. Unlike the resulting directory, other test parameters can be configured hierarchically and selectively for each test, rather than once globally.

Only by passing resultDir via the command line (per the documentation) was I able to update the currentContext for the HTML reporter.

test-only [suite] -CresultDir target/bench

scalameter/src/main/scala/org/scalameter/reporting/HtmlReporter.scala

Line 25 in 287b9a3

val resultdir = currentContext(reports.resultDir)