Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

piwik should serve a robots.txt to prevent polluting the error logs #431

Closed
anonymous-matomo-user opened this issue Nov 24, 2008 · 2 comments
Closed

piwik should serve a robots.txt to prevent polluting the error logs #431

anonymous-matomo-user opened this issue Nov 24, 2008 · 2 comments
Labels
Task Indicates an issue is neither a feature nor a bug and it's purely a "technical" change.
Milestone
RobotRock

Comments

@anonymous-matomo-user
Copy link

My server logs show many requests for a robots.txt from the crawlers of the search engines.

To stop the crawlers from polluting the logs a robots.txt should be added to the root of piwik.

I think a global dissalow is the desired behaviour in most caeses – see attached file.
@anonymous-matomo-user
Copy link
Author

Attachment:
[robots.txt](http://issues.piwik.org/attachments/431/robots.txt)

@mattab
Copy link
Member

mattab commented Nov 24, 2008

fixed in 756: empty by default

@anonymous-matomo-user anonymous-matomo-user added this to the RobotRock milestone Jul 8, 2014
Closed
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Task Indicates an issue is neither a feature nor a bug and it's purely a "technical" change.
Projects
None yet
Milestone
RobotRock
Development

No branches or pull requests
2 participants
@mattab @anonymous-matomo-user