hfcydc.com
robots.txt
Robots Exclusion Standard data for hfcydc.com
Resource Scan
Scan Details
Site Domain | hfcydc.com |
Base Domain | hfcydc.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-13T21:11:34+00:00 |
Next Scan | 2025-01-11T21:11:34+00:00 |
Last Successful Scan
Scanned | 2024-02-23T01:08:45+00:00 |
URL | https://hfcydc.com/robots.txt |
Redirect | https://www.hfcydc.com/robots.txt |
Redirect Domain | www.hfcydc.com |
Redirect Base | hfcydc.com |
Domain IPs | 104.21.78.158, 172.67.223.188, 2606:4700:3030::6815:4e9e, 2606:4700:3034::ac43:dfbc |
Redirect IPs | 23.225.201.142, 23.225.228.219, 23.225.228.220, 23.225.228.222, 45.205.3.172, 45.205.8.202, 45.205.8.220, 45.205.8.230, 45.205.8.234, 45.205.8.247 |
Response IP | 45.205.8.247 |
Found | Yes |
Hash | 01cc1541b73523cd3d51d0c48cdce88c46746b540fdb1df532d4271d1319670f |
SimHash | 41f5877b769a |
Groups
baiduspider
Rule | Path |
---|---|
Disallow | /jiexi/ |
Disallow | /rss.xml |
Disallow | /rss/index.xml |
Disallow | /rss/baidu.xml |
Disallow | /rss/google.xml |
Disallow | /rss/bing.xml |
Disallow | /rss/sogou.xml |
Disallow | /rss/so.xml |
Disallow | /rss/sm.xml |
Disallow | /include/ |
Disallow | /template/ |
Disallow | /extend/ |
Disallow | /images/ |
Disallow | /application/ |
Disallow | /runtime/ |
Disallow | /static/ |
Disallow | /search/ |
Disallow | /install |
Disallow | /show.php |
Disallow | .gif$ |
Disallow | /*?* |
Allow | .html$ |
Allow | /$ |
googlebot
Rule | Path |
---|---|
Disallow | / |
Disallow | /vodtype/ |
Disallow | /vodshow/ |
Disallow | /voddetail/ |
Disallow | /vodplay/ |
Disallow | /t/ |
Disallow | /s/ |
Disallow | /v/ |
Disallow | /p/ |
Disallow | /jiexi/ |
Disallow | /include/ |
Disallow | /template/ |
Disallow | /extend/ |
Disallow | /images/ |
Disallow | /application/ |
Disallow | /runtime/ |
Disallow | /static/ |
Disallow | /install |
Disallow | /search |
Disallow | /show.php |
Disallow | .gif$ |
bingbot
Rule | Path |
---|---|
Disallow | /jiexi/ |
Disallow | /rss.xml |
Disallow | /rss/index.xml |
Disallow | /rss/baidu.xml |
Disallow | /rss/google.xml |
Disallow | /rss/bing.xml |
Disallow | /rss/sogou.xml |
Disallow | /rss/so.xml |
Disallow | /rss/sm.xml |
Disallow | /include/ |
Disallow | /template/ |
Disallow | /extend/ |
Disallow | /images/ |
Disallow | /application/ |
Disallow | /runtime/ |
Disallow | /static/ |
Disallow | /search/ |
Disallow | /install |
Disallow | /show.php |
Disallow | .gif$ |
Disallow | /*?* |
Allow | .html$ |
Allow | /$ |
yisouspider
Rule | Path |
---|---|
Disallow | /jiexi/ |
Disallow | /rss.xml |
Disallow | /rss/index.xml |
Disallow | /rss/baidu.xml |
Disallow | /rss/google.xml |
Disallow | /rss/bing.xml |
Disallow | /rss/sogou.xml |
Disallow | /rss/so.xml |
Disallow | /rss/sm.xml |
Disallow | /include/ |
Disallow | /template/ |
Disallow | /extend/ |
Disallow | /images/ |
Disallow | /application/ |
Disallow | /runtime/ |
Disallow | /static/ |
Disallow | /search/ |
Disallow | /install |
Disallow | /show.php |
Disallow | .gif$ |
Disallow | /*?* |
Allow | .html$ |
Allow | /$ |
sogouspider
Rule | Path |
---|---|
Disallow | /jiexi/ |
Disallow | /rss.xml |
Disallow | /rss/index.xml |
Disallow | /rss/baidu.xml |
Disallow | /rss/google.xml |
Disallow | /rss/bing.xml |
Disallow | /rss/sogou.xml |
Disallow | /rss/so.xml |
Disallow | /rss/sm.xml |
Disallow | /include/ |
Disallow | /template/ |
Disallow | /extend/ |
Disallow | /images/ |
Disallow | /application/ |
Disallow | /runtime/ |
Disallow | /static/ |
Disallow | /search/ |
Disallow | /install |
Disallow | /search |
Disallow | /show.php |
Disallow | .gif$ |
Disallow | /*?* |
Allow | .html$ |
Allow | /$ |
bytespider
Rule | Path |
---|---|
Disallow | /jiexi/ |
Disallow | /rss.xml |
Disallow | /rss/index.xml |
Disallow | /rss/baidu.xml |
Disallow | /rss/google.xml |
Disallow | /rss/bing.xml |
Disallow | /rss/sogou.xml |
Disallow | /rss/so.xml |
Disallow | /rss/sm.xml |
Disallow | /include/ |
Disallow | /template/ |
Disallow | /extend/ |
Disallow | /images/ |
Disallow | /application/ |
Disallow | /runtime/ |
Disallow | /static/ |
Disallow | /search/ |
Disallow | /install |
Disallow | /search |
Disallow | /show.php |
Disallow | .gif$ |
Disallow | /*?* |
Allow | .html$ |
Allow | /$ |
yahoo! slurp
Rule | Path |
---|---|
Disallow | /jiexi/ |
Disallow | /rss.xml |
Disallow | /rss/index.xml |
Disallow | /rss/baidu.xml |
Disallow | /rss/google.xml |
Disallow | /rss/bing.xml |
Disallow | /rss/sogou.xml |
Disallow | /rss/so.xml |
Disallow | /rss/sm.xml |
Disallow | /include/ |
Disallow | /template/ |
Disallow | /extend/ |
Disallow | /images/ |
Disallow | /application/ |
Disallow | /runtime/ |
Disallow | /static/ |
Disallow | /search/ |
Disallow | /install |
Disallow | /show.php |
Disallow | .gif$ |
Disallow | /*?* |
Allow | .html$ |
Allow | /$ |
Warnings
- 24 invalid lines.