derelictdoug.net
robots.txt

Robots Exclusion Standard data for derelictdoug.net

Resource Scan

Scan Details

Site Domain derelictdoug.net
Base Domain derelictdoug.net
Scan Status Ok
Last Scan2025-11-27T19:06:10+00:00
Next Scan 2025-12-04T19:06:10+00:00

Last Scan

Scanned2025-11-27T19:06:10+00:00
URL https://derelictdoug.net/robots.txt
Redirect https://www.derelictdoug.net/robots.txt
Redirect Domain www.derelictdoug.net
Redirect Base derelictdoug.net
Domain IPs 199.34.228.69
Redirect IPs 199.34.228.69
Response IP 199.34.228.69
Found Yes
Hash 0a1d230f9c01e1ab1446f76a301f697babb252961d90dc14c159442761d80673
SimHash a854ce46eab1

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//www.derelictdoug.net/
Disallow /videos.html
Disallow /photos--maps.html
Disallow /support.html
Disallow /contact-doug.html
Disallow /derelict-doug-faceook.html
Disallow /privacy-policy.html
Disallow /privacy-policy-785641.html
Disallow /analytics.html
Disallow /opt-out--information-request.html
Disallow /posts.html

Other Records

Field Value
sitemap https://www.derelictdoug.net/sitemap.xml