douguo.net
robots.txt
Robots Exclusion Standard data for douguo.net
Resource Scan
Scan Details
| Site Domain | douguo.net |
| Base Domain | douguo.net |
| Scan Status | Ok |
| Last Scan | 2024-11-11T20:26:48+00:00 |
| Next Scan | 2024-11-18T20:26:48+00:00 |
Last Scan
| Scanned | 2024-11-11T20:26:48+00:00 |
| URL | https://www.douguo.net/robots.txt |
| Domain IPs | 119.254.81.86 |
| Response IP | 119.254.81.86 |
| Found | Yes |
| Hash | 7196253f359b3adc9ff9f3ed9d5a68c4edc4874640a4712e6a603afd68c8d36f |
| SimHash | 6b1650d5cf15 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /zhcn/ |
| Disallow | /calory/ |
| Disallow | /slimstat/ |
| Disallow | /special/moon/ |
| Disallow | /memcache.php |
| Disallow | /printcook/* |
| Disallow | /ajax/getCommentsList* |
| Disallow | /uajax/getMoreDiet* |
| Disallow | /uajax/ajaxReQuestion* |
| Disallow | /uajax/getMoreStoreDiet* |
| Disallow | /ask/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.douguo.com/sitemap.xml |