69shu.com
robots.txt

Robots Exclusion Standard data for 69shu.com

Resource Scan

Scan Details

Site Domain 69shu.com
Base Domain 69shu.com
Scan Status Ok
Last Scan2024-05-24T00:18:32+00:00
Next Scan 2024-05-31T00:18:32+00:00

Last Scan

Scanned2024-05-24T00:18:32+00:00
URL https://69shu.com/robots.txt
Redirect https://www.69shuba.pro/robots.txt
Redirect Domain www.69shuba.pro
Redirect Base 69shuba.pro
Domain IPs 18.155.68.118, 18.155.68.31, 18.155.68.64, 18.155.68.88, 2600:9000:23d2:1800:1a:dcca:2c0:93a1, 2600:9000:23d2:1e00:1a:dcca:2c0:93a1, 2600:9000:23d2:2000:1a:dcca:2c0:93a1, 2600:9000:23d2:4800:1a:dcca:2c0:93a1, 2600:9000:23d2:5200:1a:dcca:2c0:93a1, 2600:9000:23d2:9a00:1a:dcca:2c0:93a1, 2600:9000:23d2:b600:1a:dcca:2c0:93a1, 2600:9000:23d2:cc00:1a:dcca:2c0:93a1
Redirect IPs 18.140.42.173, 2406:da18:55d:a000:78f6:b547:4e2c:55d5
Response IP 18.140.42.173
Found Yes
Hash dc16aab54dd72bc9f15be085e819c89734c74a1cea6107afe45b3945f1607bff
SimHash 0256d5326c10

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /*.php
Disallow /modules/article/search.php
Disallow /modules/article/addbookcase.php
Disallow /getpass.php
Disallow /newmessage.php
Disallow /jilu/
Disallow /adclick.php
Disallow /register.php
Disallow /userfriends.php
Disallow /getpass.php
Disallow /html/
Disallow /files/
Disallow /author/
Disallow /modules/
Disallow /images/