foxycombat.com
robots.txt

Robots Exclusion Standard data for foxycombat.com

Resource Scan

Scan Details

Site Domain foxycombat.com
Base Domain foxycombat.com
Scan Status Ok
Last Scan2024-09-13T11:23:04+00:00
Next Scan 2024-10-13T11:23:04+00:00

Last Scan

Scanned2024-09-13T11:23:04+00:00
URL https://foxycombat.com/robots.txt
Redirect https://www.foxycombat.com/robots.txt
Redirect Domain www.foxycombat.com
Redirect Base foxycombat.com
Domain IPs 37.252.252.62
Redirect IPs 37.252.252.62
Response IP 37.252.252.62
Found Yes
Hash 94b7761176d10eb840aa65b79555cc481b78de061269b725b72bda0adf199241
SimHash 6840d9815635

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler

No rules defined. All paths allowed.

Comments

  • disallow all
  • but allow only important bots