bestofbest.top
robots.txt

Robots Exclusion Standard data for bestofbest.top

Resource Scan

Scan Details

Site Domain bestofbest.top
Base Domain bestofbest.top
Scan Status Ok
Last Scan2024-10-24T15:00:15+00:00
Next Scan 2024-11-23T15:00:15+00:00

Last Scan

Scanned2024-10-24T15:00:15+00:00
URL http://www.bestofbest.top/robots.txt
Redirect https://www.bestofbest.top/robots.txt
Domain IPs 108.156.133.23, 108.156.133.27, 108.156.133.4, 108.156.133.78, 2600:9000:2755:2000:16:93d2:740:93a1, 2600:9000:2755:4800:16:93d2:740:93a1, 2600:9000:2755:6400:16:93d2:740:93a1, 2600:9000:2755:8a00:16:93d2:740:93a1, 2600:9000:2755:8e00:16:93d2:740:93a1, 2600:9000:2755:a00:16:93d2:740:93a1, 2600:9000:2755:cc00:16:93d2:740:93a1, 2600:9000:2755:d600:16:93d2:740:93a1
Response IP 108.156.133.78
Found Yes
Hash e4c09c02b110889a1eb43376b6e88fb7630b35137617913a22905a98ac326650
SimHash 75048ddd0d11

Groups

*

Rule Path
Disallow /m-login
Disallow /ce_make.html
Disallow /cyproductlist_1/
Disallow /verify.html

baiduspider/2.0

Rule Path
Disallow /producer/
Disallow /thirdcode/
Disallow /nportal/
Disallow /icp
Disallow *api*
Disallow *.php
Disallow *.asp
Disallow /admin/
Disallow /npublic/
Disallow /thirdcode/
Disallow /site.txt

Other Records

Field Value
sitemap https://www.bestofbest.top/sitemap.xml