magsguru.com
robots.txt

Robots Exclusion Standard data for magsguru.com

Resource Scan

Scan Details

Site Domain magsguru.com
Base Domain magsguru.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-07T03:52:57+00:00
Next Scan 2025-12-07T03:52:57+00:00

Last Successful Scan

Scanned2025-09-14T23:18:23+00:00
URL https://magsguru.com/robots.txt
Redirect https://www.magsguru.com/robots.txt
Redirect Domain www.magsguru.com
Redirect Base magsguru.com
Domain IPs 104.21.42.87, 172.67.203.172, 2606:4700:3034::ac43:cbac, 2606:4700:3037::6815:2a57
Redirect IPs 104.21.42.87, 172.67.203.172, 2606:4700:3034::ac43:cbac, 2606:4700:3037::6815:2a57
Response IP 172.67.203.172
Found Yes
Hash 3b1fded3b6653f2a5f43693df54b28224df5a78f9ff78113ee98bcfd125993b2
SimHash 5b1c49026eb0

Groups

semrushbot
seznambot
petalbot
ahrefsbot
dotbot
mj12bot
adsbot
blexbot
linguee
ccbot
chatgpt
claudebot
facebookbot
megaindex.ru

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Allow /wp-content/themes/
Allow /wp-content/uploads/