Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Archiving should trigger limited number of concurrent requests #5035

Closed
mattab opened this issue Apr 23, 2014 · 1 comment
Closed

Archiving should trigger limited number of concurrent requests #5035

mattab opened this issue Apr 23, 2014 · 1 comment
Assignees
@mattab
Labels
c: Performance For when we could improve the performance / speed of Matomo. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical. Task Indicates an issue is neither a feature nor a bug and it's purely a "technical" change.
Milestone
2.2.1

Comments

@mattab
Copy link
Member

mattab commented Apr 23, 2014

Currently if there are eg. 20 custom segments to generate for a given website, the auto archive command core:archive will trigger 20 concurrent requests to the API.

This can result in some of these requests failing. Instead we should only process at the same time a max count of requests, so that we don't overload the server.

This change will result in better performance of archiving and more reliability when there are many custom segments to pre-process.
@mattab
Copy link
Member Author

mattab commented Apr 23, 2014

In 135624d: Fixes #5035 CliMulti can now trigger a limited number of concurrent requests.
This is set to three concurrent processes in core:archive command.
Refs #4903

@mattab mattab added this to the 2.2.1 - Piwik 2.2.1 milestone Jul 8, 2014
@mattab mattab self-assigned this Jul 8, 2014
@dev-101 dev-101 mentioned this issue May 14, 2014
Closed
sabl0r pushed a commit to sabl0r/piwik that referenced this issue Sep 23, 2014
@mattab
Fixes matomo-org#5035 CliMulti can now trigger a limited number of co…
135624d 
…ncurrent requests.

This is set to three concurrent processes in core:archive command.
Refs matomo-org#4903
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mattab mattab

Labels
c: Performance For when we could improve the performance / speed of Matomo. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical. Task Indicates an issue is neither a feature nor a bug and it's purely a "technical" change.
Projects
None yet
Milestone
2.2.1
Development

No branches or pull requests
1 participant
@mattab