undermined.org
robots.txt

Robots Exclusion Standard data for undermined.org

Resource Scan

Scan Details

Site Domain undermined.org
Base Domain undermined.org
Scan Status Ok
Last Scan2025-09-16T07:07:34+00:00
Next Scan 2025-10-16T07:07:34+00:00

Last Scan

Scanned2025-09-16T07:07:34+00:00
URL https://undermined.org/robots.txt
Domain IPs 104.21.84.218, 172.67.197.97, 2606:4700:3036::6815:54da, 2606:4700:3036::ac43:c561
Response IP 172.67.197.97
Found Yes
Hash f781d043f118709146a75ac9f4e001747720c6f9bd9de145c28871051443696d
SimHash 2045d8820513

Groups

*

Rule Path
Disallow /files/
Disallow /inc/
Disallow /irc/

googlebot
msnbot
yahoo-slurp
teoma
gigabot
scrubby
robozilla
nutch
ia_archiver
baiduspider
googlebot-image
yahoo-mmcrawler
psbot
asterias
yahoo-blogs/v3.9

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

fasterfox

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.undermined.org/sitemap.xml

Warnings

  • 1 invalid line.