Log In Sign Up

mon3-search.clients.squiz.net
robots.txt

Robots Exclusion Standard data for mon3-search.clients.squiz.net

Resource Scan

Scan Details

Site Domain mon3-search.clients.squiz.net
Base Domain squiz.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-15T14:55:41+00:00
Next Scan 2025-11-13T14:55:41+00:00

Last Successful Scan

Scanned2024-03-31T13:30:36+00:00
URL https://mon3-search.clients.squiz.net/robots.txt
Domain IPs 202.9.95.188
Response IP 203.82.24.7
Found Yes
Hash a2c82c5c60be8556dd7bdf7658bccbe905d92440c2a858cdbe397f6a7824fe46
SimHash b0797d4b4717

Groups

*

Rule Path
Disallow /search/
Disallow /s/
Back to top

Comments

  • $Id: robots.txt 30666 2012-07-18 23:30:21Z msheppard $
  • Standard robots.txt for search system distribution. Must be located in
  • the top-level directory of the web server document hierarchy.
  • Ref: http://www.robotstxt.org/wc/exclusion.html
Back to top