hotbiankax.com
robots.txt
Robots Exclusion Standard data for hotbiankax.com
Resource Scan
Scan Details
Site Domain | hotbiankax.com |
Base Domain | hotbiankax.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-05T03:48:33+00:00 |
Next Scan | 2024-11-04T03:48:33+00:00 |
Last Successful Scan
Scanned | 2024-08-13T04:30:45+00:00 |
URL | https://hotbiankax.com/robots.txt |
Domain IPs | 131.153.29.74 |
Response IP | 131.153.29.74 |
Found | Yes |
Hash | 47979d5fec777cc289a3831173fe4d0fedf6736990ec9fcdaaebe8e8ac6cc60f |
SimHash | 64ca1062c3a2 |
Groups
*
Rule | Path |
---|---|
Disallow | /online.js |
mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Rule | Path |
---|---|
Disallow | / |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /cgi-sys/ |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
sitemap | /sitemap.xml |
Warnings
- 8 invalid lines.
Comments