shenlongbbs.com
robots.txt

Robots Exclusion Standard data for shenlongbbs.com

Resource Scan

Scan Details

Site Domain shenlongbbs.com
Base Domain shenlongbbs.com
Scan Status Ok
Last Scan2024-11-12T00:22:31+00:00
Next Scan 2024-11-19T00:22:31+00:00

Last Scan

Scanned2024-11-12T00:22:31+00:00
URL https://shenlongbbs.com/robots.txt
Domain IPs 104.21.28.176, 172.67.146.240
Response IP 104.21.28.176
Found Yes
Hash e3d877a011c3f2a029e72cec4b83c4f9672bd01936288f246debd14e643f5065
SimHash 805c4c70298b

Groups

*

Rule Path
Disallow /admin
Disallow /user-*
Disallow /serach-*

ahrefsbot
semrushbot
mj12bot
dotbot
serpstatbot
dataforseobot
panscient.com
friendly_crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shenlongbbs.com/sitemap-0.xml