69shu.pro
robots.txt

Robots Exclusion Standard data for 69shu.pro

Resource Scan

Scan Details

Site Domain 69shu.pro
Base Domain 69shu.pro
Scan Status Ok
Last Scan2024-05-26T00:58:41+00:00
Next Scan 2024-06-02T00:58:41+00:00

Last Scan

Scanned2024-05-26T00:58:41+00:00
URL https://69shu.pro/robots.txt
Redirect https://www.69shuba.pro/robots.txt
Redirect Domain www.69shuba.pro
Redirect Base 69shuba.pro
Domain IPs 108.156.133.10, 108.156.133.104, 108.156.133.106, 108.156.133.112
Redirect IPs 18.140.42.173, 2406:da18:55d:a000:78f6:b547:4e2c:55d5
Response IP 18.140.42.173
Found Yes
Hash dc16aab54dd72bc9f15be085e819c89734c74a1cea6107afe45b3945f1607bff
SimHash 0256d5326c10

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /*.php
Disallow /modules/article/search.php
Disallow /modules/article/addbookcase.php
Disallow /getpass.php
Disallow /newmessage.php
Disallow /jilu/
Disallow /adclick.php
Disallow /register.php
Disallow /userfriends.php
Disallow /getpass.php
Disallow /html/
Disallow /files/
Disallow /author/
Disallow /modules/
Disallow /images/