I am using jenkins pipeline script to run jmeter script and am using performance plugin to create performanceReport as below
performanceReport parsers: [[$class: 'JMeterParser', glob: "**/*.jtl"]], modeOfThreshold: true,relativeFailedThresholdNegative: 1.2, relativeFailedThresholdPositive: 1.89, relativeUnstableThresholdNegative: 1.8, relativeUnstableThresholdPositive: 1.5
In the below performance trend though errors are increased the build is green so I'm trying to configure Jenkins performance plugin to fail job if the percentage of errors increase by X %
or response time decrease/increase by X %
with respect to previous build(s) . can someone please help me with it?
Install the Performance plugin To integrate JMeter with Jenkins, we will use the Performance plugin. Follow these steps to install it: From your Jenkins dashboard page, go to: Manage Jenkins. Go to the Manage Plugins page.
perfReport : Publish Performance test result reportPlugin will be automatically detect parser for each report file. You can specify multiple files and directories separated by semicolon.
Jenkins will generate graphic charts with the trend report of performance and robustness. It includes the feature of setting the final build status as good, unstable or failed, based on the reported error percentage. Report formats supported: JMeter XML and CSV format, also Summarizer log output.
I think the easiest option for you is to wrap your JMeter tests using TAURUS and use the Taurus PASSFAIL module to fail the job. In the PASSFAIL module I didn't see a way to compare the errors or response time across builds, but you can define the average RT/LT etc and make the job fail based on that. Hope that helps!
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With