agilethinking.pro
robots.txt

Robots Exclusion Standard data for agilethinking.pro

Resource Scan

Scan Details

Site Domain agilethinking.pro
Base Domain agilethinking.pro
Scan Status Ok
Last Scan2025-12-13T08:05:00+00:00
Next Scan 2025-12-20T08:05:00+00:00

Last Scan

Scanned2025-12-13T08:05:00+00:00
URL https://agilethinking.pro/robots.txt
Domain IPs 2607:f1c0:100f:f000::2e5, 74.208.236.110
Response IP 74.208.236.110
Found Yes
Hash 732d210ff92f1ddf2925b92ec07c1bf01047bc05f43260b3ff0c89fe77e20aff
SimHash 081c9d60ef9b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap http://agilethinking.pro/sitemap21.xml