diwtt.cc
robots.txt
Robots Exclusion Standard data for diwtt.cc
Resource Scan
Scan Details
| Site Domain | diwtt.cc |
| Base Domain | diwtt.cc |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-03-04T13:53:54+00:00 |
| Next Scan | 2025-05-03T13:53:54+00:00 |
Last Successful Scan
| Scanned | 2024-12-12T13:51:44+00:00 |
| URL | http://www.diwtt.cc/robots.txt |
| Redirect | http://baidu.com/robots.txt |
| Redirect Domain | baidu.com |
| Redirect Base | baidu.com |
| Domain IPs | 23.224.75.186 |
| Redirect IPs | 110.242.68.66, 39.156.66.10 |
| Response IP | 39.156.66.10 |
| Found | Yes |
| Hash | 2d8ec3a400ae01b7af4828521ee6049bf62ce639dfac2bc3debf132ca7b3d2af |
| SimHash | 5a65dd2a2901 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
msnbot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
youdaobot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou web spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou inst spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou spider2
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou blog
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou news spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sogou orion spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
jikespider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
sosospider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
pangusospider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
yisouspider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
easouspider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
*
| Rule | Path |
|---|---|
| Disallow | / |