Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to configure Jenkins performance plugin to fail job with relative error threshold

I am using jenkins pipeline script to run jmeter script and am using performance plugin to create performanceReport as below

performanceReport parsers: [[$class: 'JMeterParser', glob: "**/*.jtl"]], modeOfThreshold: true,relativeFailedThresholdNegative: 1.2, relativeFailedThresholdPositive: 1.89, relativeUnstableThresholdNegative: 1.8, relativeUnstableThresholdPositive: 1.5

In the below performance trend though errors are increased the build is green so I'm trying to configure Jenkins performance plugin to fail job if the percentage of errors increase by X % or response time decrease/increase by X % with respect to previous build(s) . can someone please help me with it?

enter image description here

like image 952
RanPaul Avatar asked May 15 '18 19:05

RanPaul


People also ask

Which plugin must be added to Jenkins to complete the execution of the performance test plan and view the report?

Install the Performance plugin To integrate JMeter with Jenkins, we will use the Performance plugin. Follow these steps to install it: From your Jenkins dashboard page, go to: Manage Jenkins. Go to the Manage Plugins page.

Which of the following plugins are needed to publish a performance report in Jenkins?

perfReport : Publish Performance test result reportPlugin will be automatically detect parser for each report file. You can specify multiple files and directories separated by semicolon.

Which plugin integrates JMeter reports JUnit reports work output and large reports into Hudson?

Jenkins will generate graphic charts with the trend report of performance and robustness. It includes the feature of setting the final build status as good, unstable or failed, based on the reported error percentage. Report formats supported: JMeter XML and CSV format, also Summarizer log output.


1 Answers

I think the easiest option for you is to wrap your JMeter tests using TAURUS and use the Taurus PASSFAIL module to fail the job. In the PASSFAIL module I didn't see a way to compare the errors or response time across builds, but you can define the average RT/LT etc and make the job fail based on that. Hope that helps!

like image 67
Isaiah4110 Avatar answered Oct 12 '22 00:10

Isaiah4110