gdfreak.com
robots.txt
Robots Exclusion Standard data for gdfreak.com
Resource Scan
Scan Details
| Site Domain | gdfreak.com |
| Base Domain | gdfreak.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T20:18:12+00:00 |
| Next Scan | 2024-11-15T20:18:12+00:00 |
Last Scan
| Scanned | 2024-11-08T20:18:12+00:00 |
| URL | http://gdfreak.com/robots.txt |
| Redirect | https://jp.gdfreak.com/robots.txt |
| Redirect Domain | jp.gdfreak.com |
| Redirect Base | gdfreak.com |
| Domain IPs | 133.125.38.70 |
| Redirect IPs | 133.125.38.70 |
| Response IP | 133.125.38.70 |
| Found | Yes |
| Hash | 85873f4c90217719a15fa2f27e4f7aa601df2f722303d76d29800a434ae6a32b |
| SimHash | 6f85bb40a98d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /public/add_cart/ |
| Disallow | /public/view_cart/ |
| Disallow | /users/ |
| Disallow | /MyGD/ |
| Disallow | /BoughtGraphs/ |
| Disallow | /images/ |
| Allow | /images/view/ |
| Disallow | /*.xlsx$ |
| Disallow | /*.xls$ |
| Disallow | /meta/jp/trade_pdf/ |
| Disallow | /meta/jp/trade2014_pdf/ |
| Disallow | /MyGraphs/ |
| Disallow | /MyGraphs/add/ |
| Disallow | /MyGraphs/add/* |
| Disallow | /public/detail/jp010501004020112014/ |
| Disallow | /public/detail/jp010501004020112036/ |
| Disallow | /public/detail/jp010501004020122014/ |
| Disallow | /public/detail/jp010501004020122036/ |
| Disallow | /public/detail/jp010501004040112014/ |
| Disallow | /public/detail/jp010501004040112036/ |
| Disallow | /public/detail/jp010501004040122014/ |
| Disallow | /public/detail/jp010501004040122036/ |
| Disallow | /public/detail/jp01005000201*/ |
| Disallow | /public/detail/jp01005000205*/ |
| Disallow | /public/detail/jp0105010010501*/ |
| Disallow | /public/detail/jp0105010010101*/ |
| Disallow | /public/detail/jp0105010020501*/ |
| Disallow | /public/detail/jp0105010020101*/ |
| Disallow | /public/detail/jp0101400110101*/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://jp.gdfreak.com/jpgdfreaksitemapindex.xml |