l.guigs01.com
robots.txt

Robots Exclusion Standard data for l.guigs01.com

Resource Scan

Scan Details

Site Domain l.guigs01.com
Base Domain guigs01.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-19T13:01:46+00:00
Next Scan 2025-10-19T13:01:46+00:00

Last Successful Scan

Scanned2025-07-29T11:51:18+00:00
URL https://l.guigs01.com/robots.txt
Domain IPs 104.21.89.28, 172.67.136.142, 2606:4700:3033::6815:591c, 2606:4700:3034::ac43:888e
Response IP 104.21.89.28
Found Yes
Hash 229bcb495fabc94a327135b413f821fa72f6c64a3d179db52f74ed4986f9d915
SimHash 595c41e0ab8b

Groups

*

Rule Path
Disallow /search.shtml

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /