igrc.org
robots.txt

Robots Exclusion Standard data for igrc.org

Resource Scan

Scan Details

Site Domain igrc.org
Base Domain igrc.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-31T03:45:11+00:00
Next Scan 2025-12-30T03:45:11+00:00

Last Successful Scan

Scanned2025-08-09T17:11:36+00:00
URL https://www.igrc.org/robots.txt
Domain IPs 13.84.31.161
Response IP 13.84.31.161
Found Yes
Hash 8168424ddffb3c0edd39c7e4a53a4f37143f873eb6160c12e1f01888152e5426
SimHash e21d5c11e493

Groups

bingbot
googlebot
addsearchbot
facebookbot
facebookexternalhit
linkedinbot
applebot
slurp
duckduckbot
web-site-map
ia_archiver

Rule Path
Disallow

*

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.igrc.org/sitemap.xml