douggoyen.com
robots.txt

Robots Exclusion Standard data for douggoyen.com

Resource Scan

Scan Details

Site Domain douggoyen.com
Base Domain douggoyen.com
Scan Status Ok
Last Scan2024-10-24T08:13:39+00:00
Next Scan 2024-11-23T08:13:39+00:00

Last Scan

Scanned2024-10-24T08:13:39+00:00
URL https://douggoyen.com/robots.txt
Redirect https://www.douggoyen.com/robots.txt
Redirect Domain www.douggoyen.com
Redirect Base douggoyen.com
Domain IPs 50.17.254.73
Redirect IPs 108.157.254.53, 108.157.254.64, 108.157.254.69, 108.157.254.84
Response IP 108.157.254.84
Found Yes
Hash cec248288713a5b1e1ce0efb5d82c436c3aff46ab647d02748d32923dfe033c5
SimHash 09344872ef93

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/*
Disallow /captcha/*
Allow /

Other Records

Field Value
sitemap https://www.douggoyen.com/geositemap.xml
sitemap https://www.douggoyen.com/sitemap.xml