Log In Sign Up

oldgloryminiatures.com
robots.txt

Robots Exclusion Standard data for oldgloryminiatures.com

Resource Scan

Scan Details

Site Domain oldgloryminiatures.com
Base Domain oldgloryminiatures.com
Scan Status Ok
Last Scan2024-09-22T04:06:13+00:00
Next Scan 2024-10-22T04:06:13+00:00

Last Scan

Scanned2024-09-22T04:06:13+00:00
URL https://oldgloryminiatures.com/robots.txt
Redirect https://www.oldgloryminiatures.com/robots.txt
Redirect Domain www.oldgloryminiatures.com
Redirect Base oldgloryminiatures.com
Domain IPs 204.140.21.20
Redirect IPs 204.140.21.20
Response IP 204.140.21.20
Found Yes
Hash 5e5e553bd26fd04a9781e2f330722cceaecde0d98839056b76ab3df4cb738039
SimHash 2e5a4aa4e7d1

Groups

fatbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

dealozbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • MC 1/24/2012 added to discourage continual abuse from The Find on the 208.83.156.* range
Back to top