squier-talk.com
robots.txt

Robots Exclusion Standard data for squier-talk.com

Resource Scan

Scan Details

Site Domain squier-talk.com
Base Domain squier-talk.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-20T05:36:29+00:00
Next Scan 2024-06-18T05:36:29+00:00

Last Successful Scan

Scanned2023-08-23T12:21:45+00:00
URL https://squier-talk.com/robots.txt
Domain IPs 104.21.41.234, 172.67.196.180, 2606:4700:3034::ac43:c4b4, 2606:4700:3037::6815:29ea
Response IP 172.67.196.180
Found Yes
Hash f12d64d2c70b3d572462c1992e9fb453a02261710176759d115e57474a2e1df0
SimHash 2832cc70268b

Groups

boardreader

Rule Path
Disallow /

boardtracker

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow /tmp/
Disallow /test/
Disallow /ssh/
Disallow /xcache/
Disallow /plesk-stat/
Disallow /picture_library/
Disallow /phpmyadmin/
Disallow /dev/
Disallow /chat/
Disallow /calendar/
Disallow /ads-direct/
Disallow /account/
Disallow /ajax/
Disallow /conversations/
Disallow /find-new/
Disallow /goto/
Disallow /help/
Disallow /login/
Disallow /lost-password/
Disallow /members/
Disallow /online/
Disallow /register/
Disallow /search/
Disallow /admin.php
Disallow /forum/archive
Disallow /Hide_vB_Forum_dir
Disallow /Save_From_wRoot

Other Records

Field Value
crawl-delay 2