d1.net.cn
robots.txt
Robots Exclusion Standard data for d1.net.cn
Resource Scan
Scan Details
| Site Domain | d1.net.cn |
| Base Domain | d1.net.cn |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-30T00:11:43+00:00 |
| Next Scan | 2024-11-29T00:11:43+00:00 |
Last Successful Scan
| Scanned | 2024-07-10T00:05:34+00:00 |
| URL | https://d1.net.cn/robots.txt |
| Redirect | https://baike.d1.net.cn/robots.txt |
| Redirect Domain | baike.d1.net.cn |
| Redirect Base | d1.net.cn |
| Domain IPs | 104.21.68.64, 172.67.191.37, 2606:4700:3030::6815:4440, 2606:4700:3032::ac43:bf25 |
| Redirect IPs | 104.21.68.64, 172.67.191.37, 2606:4700:3030::6815:4440, 2606:4700:3032::ac43:bf25 |
| Response IP | 172.67.191.37 |
| Found | Yes |
| Hash | 8f9280d65114314483997139209753fa1fdcbe0ae2332d3425a13d1d7e87a036 |
| SimHash | 8d448cc887a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /plus/ad_js.php |
| Disallow | /plus/advancedsearch.php |
| Disallow | /plus/car.php |
| Disallow | /plus/carbuyaction.php |
| Disallow | /plus/shops_buyaction.php |
| Disallow | /plus/erraddsave.php |
| Disallow | /plus/posttocar.php |
| Disallow | /plus/disdls.php |
| Disallow | /plus/feedback_js.php |
| Disallow | /plus/mytag_js.php |
| Disallow | /plus/rss.php |
| Disallow | /plus/search.php |
| Disallow | /plus/recommend.php |
| Disallow | /plus/stow.php |
| Disallow | /plus/count.php |
| Disallow | /include |
| Disallow | /templets |