69shuba.com
robots.txt

Robots Exclusion Standard data for 69shuba.com

Resource Scan

Scan Details

Site Domain 69shuba.com
Base Domain 69shuba.com
Scan Status Ok
Last Scan2024-05-11T02:35:15+00:00
Next Scan 2024-05-18T02:35:15+00:00

Last Scan

Scanned2024-05-11T02:35:15+00:00
URL https://69shuba.com/robots.txt
Redirect https://www.69shuba.pro/robots.txt
Redirect Domain www.69shuba.pro
Redirect Base 69shuba.pro
Domain IPs 18.155.68.105, 18.155.68.13, 18.155.68.83, 18.155.68.91, 2600:9000:23d2:3000:12:4ab:8d80:93a1, 2600:9000:23d2:6200:12:4ab:8d80:93a1, 2600:9000:23d2:7c00:12:4ab:8d80:93a1, 2600:9000:23d2:8a00:12:4ab:8d80:93a1, 2600:9000:23d2:9c00:12:4ab:8d80:93a1, 2600:9000:23d2:d000:12:4ab:8d80:93a1, 2600:9000:23d2:d200:12:4ab:8d80:93a1, 2600:9000:23d2:fc00:12:4ab:8d80:93a1
Redirect IPs 18.140.42.173, 2406:da18:55d:a000:78f6:b547:4e2c:55d5
Response IP 18.140.42.173
Found Yes
Hash a6c3350b5c083ae5d2ac0c18ef312bbb9e5ac77f5c332f2267ed2b72b0a32d10
SimHash 025695314c11

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /login.php
Disallow /modules/article/addbookcase.php
Disallow /getpass.php
Disallow /newmessage.php
Disallow /jilu/
Disallow /adclick.php
Disallow /register.php
Disallow /userfriends.php
Disallow /getpass.php
Disallow /html/
Disallow /files/
Disallow /author/
Disallow /modules/
Disallow /images/