Ticket #431 (closed Task: fixed)

Opened 3 years ago

Last modified 3 years ago

piwik should serve a robots.txt to prevent polluting the error logs

Reported by: JUSI Owned by:
Priority: normal Milestone: RobotRock
Component: Core Keywords:
Cc: Sensitive:

Description

My server logs show many requests for a robots.txt from the crawlers of the search engines.

To stop the crawlers from polluting the logs a robots.txt should be added to the root of piwik.

I think a global dissalow is the desired behaviour in most caeses - see attached file.

Attachments

robots.txt Download (25 bytes) - added by JUSI 3 years ago.

Change History

Changed 3 years ago by JUSI

Changed 3 years ago by matt

  • status changed from new to closed
  • resolution set to fixed
  • milestone set to RobotRock

fixed in [756]: empty by default

Note: See TracTickets for help on using tickets.