robertsonquay.com
robots.txt

Robots Exclusion Standard data for robertsonquay.com

Resource Scan

Scan Details

Site Domain robertsonquay.com
Base Domain robertsonquay.com
Scan Status Ok
Last Scan2025-11-27T18:43:50+00:00
Next Scan 2025-12-04T18:43:50+00:00

Last Scan

Scanned2025-11-27T18:43:50+00:00
URL https://robertsonquay.com/robots.txt
Redirect https://www.robertsonquay.com/robots.txt
Redirect Domain www.robertsonquay.com
Redirect Base robertsonquay.com
Domain IPs 104.21.19.206, 172.67.190.48, 2606:4700:3030::ac43:be30, 2606:4700:3035::6815:13ce
Redirect IPs 104.21.19.206, 172.67.190.48, 2606:4700:3030::ac43:be30, 2606:4700:3035::6815:13ce
Response IP 104.21.19.206
Found Yes
Hash 24dab32a3b913749617ec9e185bbc62a9991bcdccf23d36dcfd1bfbd3b28417e
SimHash ca1cdc742793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /park-hotel-clarke-quay-old.html
Disallow /village-residence-clarke-quay1.html
Disallow /village-residence-robertson-quay1.html

Other Records

Field Value
sitemap http://www.robertsonquay.com/sitemap.xml