Visually explore your JMH benchmarks on Jenkins!
Based on JMH Visualizer.
Given your project runs JMH benchmarks, you can use this plugin to visualize the results of it. The results need to be stored in JSON therefore.
jmhReport 'build/reports/jmh/result.json'
OR
step([$class: 'RunPublisher', resultPath: 'build/reports/jmh/result.json'])
A complete pipeline could look like that:
node {
checkout([$class: 'GitSCM', branches: [[name: '*/master']], userRemoteConfigs: [[url: 'https://github.com/ben-manes/caffeine.git']]])
sh './gradlew jmh -PincludePattern=".*DelegationBenchmark.*"'
jmhReport 'caffeine/build/reports/jmh/results.json'
}
jmhReport { resultPath('build/reports/jmh/result.json') }
A complete job-dsl example could look like that:
job('example-1') {
steps {
scm {
git("https://github.com/ben-manes/caffeine.git", "master")
}
shell('./gradlew jmh -PincludePattern=".*DelegationBenchmark.*"')
publishers {
jmhReport {
resultPath('build/reports/jmh/result.json')
}
}
}
}
- Setup project for eclipse:
mvn -DdownloadSources=true eclipse:eclipse
- Run a Jenkins instance with the plugin deployed
mvn hpi:run
- go to http:https://127.0.0.1:8080/jenkins
- (Only on jmh-visualizer update) Copy bundle.js (from jmh-visualizer) into src/main/webapp/
- (Only on major version change) Change version in pom.xml to ${version}-SNAPSHOT
- Test the Plugin in dev mode:
mvn hpi:run
- Test the Plugin on a Jenkins instance:
- Build the HPI:
mvn hpi:hpi
- Download and install Jenkins (https://jenkins.io/download/)
- Start and stop on a Mac with
- sudo launchctl load /Library/LaunchDaemons/org.jenkins-ci.plist
- sudo launchctl unload /Library/LaunchDaemons/org.jenkins-ci.plist
- Upload the HPI (target/jmh-report.hpi) into the local Jenkins instance
- Build the HPI:
- Commit & Push
- Release:
mvn release:prepare release:perform
- Update https://wiki.jenkins.io/display/JENKINS/JMH+Report+Plugin