ritchielist.com
robots.txt

Robots Exclusion Standard data for ritchielist.com

Resource Scan

Scan Details

Site Domain ritchielist.com
Base Domain ritchielist.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-27T04:27:11+00:00
Next Scan 2024-09-25T04:27:11+00:00

Last Successful Scan

Scanned2023-11-05T17:53:51+00:00
URL https://ritchielist.com/robots.txt
Redirect https://www.ritchielist.com/robots.txt
Redirect Domain www.ritchielist.com
Redirect Base ritchielist.com
Domain IPs 85.17.240.143
Redirect IPs 13.33.88.129, 13.33.88.4, 13.33.88.45, 13.33.88.49, 2600:9000:223b:1600:16:d0e2:95c0:93a1, 2600:9000:223b:4200:16:d0e2:95c0:93a1, 2600:9000:223b:8600:16:d0e2:95c0:93a1, 2600:9000:223b:9200:16:d0e2:95c0:93a1, 2600:9000:223b:a400:16:d0e2:95c0:93a1, 2600:9000:223b:cc00:16:d0e2:95c0:93a1, 2600:9000:223b:ce00:16:d0e2:95c0:93a1, 2600:9000:223b:d600:16:d0e2:95c0:93a1
Response IP 18.164.52.35
Found Yes
Hash e5bd4e7627801930b32128127d37e2e566f02574e595848714c43aa8bf99226b
SimHash 002cd450ec13

Groups

mediapartners-google

Rule Path
Disallow

baiduspider
rogerbot
exabot
mj12bot
dotbot
gigabot
ahrefsbot
semrushbot
semrushbot-sa
caliperbot
bytespider
gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /%2B/*
Disallow /%2B/categorypath

Other Records

Field Value
sitemap https://www.ritchielist.com/sitemap_index_rl.xml