apetrifiedforest.com
robots.txt

Robots Exclusion Standard data for apetrifiedforest.com

Resource Scan

Scan Details

Site Domain apetrifiedforest.com
Base Domain apetrifiedforest.com
Scan Status Ok
Last Scan2025-12-09T00:21:11+00:00
Next Scan 2026-01-08T00:21:11+00:00

Last Scan

Scanned2025-12-09T00:21:11+00:00
URL https://apetrifiedforest.com/robots.txt
Redirect https://www.apetrifiedforest.com/robots.txt
Redirect Domain www.apetrifiedforest.com
Redirect Base apetrifiedforest.com
Domain IPs 199.34.228.47
Redirect IPs 199.34.228.47
Response IP 199.34.228.47
Found Yes
Hash 600716a334de228157e7681b37585c096929ee893f46078ed1068bc7b53edcf5
SimHash 4a14dc7c23b3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /media-links.html
Disallow /societies-in-shadow.html
Disallow /tickets-2022.html

Other Records

Field Value
sitemap https://www.apetrifiedforest.com/sitemap.xml