Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Jenkins Report for Performance Benchmarks #3280

Closed
mattab opened this issue Jul 27, 2012 · 2 comments
Closed

Jenkins Report for Performance Benchmarks #3280

mattab opened this issue Jul 27, 2012 · 2 comments
Labels
duplicate For issues that already existed in our issue tracker and were reported previously. Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc.

Comments

@mattab
Copy link
Member

mattab commented Jul 27, 2012

Follow up to #3177, See also: #2000

We now have Benchmarking tests in trunk, which could be helpful in testing the speed of running archiving / api requests, and measure with Jenkins the result.

This task involves:

  • look for performance reports plugins for Jenkins
  • How could we feed data to the plugin
  • What reports do we need?
  • looking at Jmeter standard which seems to be used in Performance jenkins plugins
  • Note: important to run the tests build on a server that is otherwise idle.

Note from Benaka: Integrating With Jenkins

I've looked at some plugins for Jenkins and found two that might be useful for tracking performance:

 https://wiki.jenkins-ci.org/display/JENKINS/Performance+Plugin (this one looks better)
 https://wiki.jenkins-ci.org/display/JENKINS/PerfPublisher+Plugin

Both of these process XML to get performance data. The benchmarks could be setup to output this XML when certain query parameters are used, and, if possible, Jenkins could get this data and feed it to the plugin. However, I have no experience setting up/configuring Jenkins, so I don't know what this will entail. Or if it's possible.

Currently the Benchmarking code is not used so it would be really nice to put it to use to generate continuous performance reports!
@mattab
Copy link
Member Author

mattab commented Jul 27, 2012

Or if we didn't want to use Jenkins Plugins and do it manually, we could do a fun project to Report the Build Performance in a Widget in a simple plugin in Piwik.

we could somehow fetch the build HTML result (maybe the historical is not available) with some php in a plugin, and return a historical evolution graph, with several metrics (Total Build time, Test #1 time, Test #2 time, etc) and the table below.

@mattab
Copy link
Member Author

mattab commented Jan 13, 2014

see #2000 Continuous performance testing

@mattab mattab added this to the Future releases milestone Jul 8, 2014
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate For issues that already existed in our issue tracker and were reported previously. Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mattab