rescueremedy.com
robots.txt

Robots Exclusion Standard data for rescueremedy.com

Resource Scan

Scan Details

Site Domain rescueremedy.com
Base Domain rescueremedy.com
Scan Status Ok
Last Scan2024-05-28T06:19:56+00:00
Next Scan 2024-06-27T06:19:56+00:00

Last Scan

Scanned2024-05-28T06:19:56+00:00
URL https://rescueremedy.com/robots.txt
Redirect https://www.rescueremedy.com/robots.txt
Redirect Domain www.rescueremedy.com
Redirect Base rescueremedy.com
Domain IPs 35.177.208.213
Redirect IPs 13.35.18.56, 13.35.18.6, 13.35.18.65, 13.35.18.73, 2600:9000:20c7:1600:f:e331:5b80:93a1, 2600:9000:20c7:1c00:f:e331:5b80:93a1, 2600:9000:20c7:3400:f:e331:5b80:93a1, 2600:9000:20c7:4a00:f:e331:5b80:93a1, 2600:9000:20c7:5400:f:e331:5b80:93a1, 2600:9000:20c7:6400:f:e331:5b80:93a1, 2600:9000:20c7:7c00:f:e331:5b80:93a1, 2600:9000:20c7:7e00:f:e331:5b80:93a1
Response IP 13.35.18.73
Found Yes
Hash 83bbd9152b97caa1bfe4aaf2f102ec1995ce2736dee3f69e2c13675cbe69c28c
SimHash 0400d8434157

Groups

*

Rule Path
Allow /
Disallow /admin
Disallow /dev
Disallow /sdotsform

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.rescueremedy.com/sitemap.xml

Comments

  • Robots.txt
  • Enables robots.txt rules for all crawlers
  • Rate limit Yahoo!, Bing and Yandex (Google ignores this)
  • SilverStripe sitemap: