www1.post.ch
robots.txt

Robots Exclusion Standard data for www1.post.ch

Resource Scan

Scan Details

Site Domain www1.post.ch
Base Domain post.ch
Scan Status Ok
Last Scan2024-10-06T08:54:25+00:00
Next Scan 2024-10-13T08:54:25+00:00

Last Scan

Scanned2024-10-06T08:54:25+00:00
URL https://www1.post.ch/robots.txt
Domain IPs 194.41.190.109
Response IP 194.41.190.109
Found Yes
Hash 825405773857e73d814e95cba31c03bc31883667bfb0c14207659c6fa5272cdb
SimHash 2b8cb9164dc8

Groups

*

Rule Path
Disallow /*?*tag=*
Disallow /*?*Tag=*
Disallow /*.xsd$
Disallow /*.xsd?*
Disallow /*.xls$
Disallow /*.xls?*
Disallow /*.doc$
Disallow /*.doc?*
Disallow /*.docx$
Disallow /*.docx?*
Disallow /*.zip$
Disallow /*.zip?*

Comments

  • Path
  • Parameters
  • Prevent recursive crawls of links
  • File Format

Warnings

  • 13 invalid lines.