fourseasons.com
robots.txt

Robots Exclusion Standard data for fourseasons.com

Resource Scan

Scan Details

Site Domain fourseasons.com
Base Domain fourseasons.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-04-10T23:41:09+00:00
Next Scan 2024-07-09T23:41:09+00:00

Last Successful Scan

Scanned2022-12-11T02:33:39+00:00
URL https://fourseasons.com/robots.txt
Redirect https://www.fourseasons.com/robots.txt
Redirect Domain www.fourseasons.com
Redirect Base fourseasons.com
Domain IPs 15.156.14.153, 15.223.125.99
Redirect IPs 125.56.230.118
Response IP 125.56.230.118
Found Yes
Hash 8bf4d3ac736f30814955e468c26ab05011f70c4bf5706e760633ae90a5f79abd
SimHash aa3e992327f4

Groups

facebookexternalhit

Rule Path
Disallow

*

Rule Path
Disallow /*print.html$

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /palmbeach/2016/*

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 10

wwwster

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 999

yahooseeker/cafekelsa-dev

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 999

e-societyrobot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 999

huaweisymantecspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 999

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) image size by siteimprove.com

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Comments

  • DO NOT REMOVE THIS FILE
  • this file tells all robots they are not allowed to crawl any part of the site
  • It is served instead of robots.txt on servers that are not PRIMARY
  • only the live production server is PRIMARY