hareruyamtg.com
robots.txt
Robots Exclusion Standard data for hareruyamtg.com
Resource Scan
Scan Details
| Site Domain | hareruyamtg.com |
| Base Domain | hareruyamtg.com |
| Scan Status | Ok |
| Last Scan | 2024-09-14T04:10:03+00:00 |
| Next Scan | 2024-10-14T04:10:03+00:00 |
Last Scan
| Scanned | 2024-09-14T04:10:03+00:00 |
| URL | https://www.hareruyamtg.com/robots.txt |
| Domain IPs | 52.192.194.165, 57.180.158.156 |
| Response IP | 57.180.158.156 |
| Found | Yes |
| Hash | 5fb576c653029efaf3bad0a05a9bb49b43f4178a585862d2eef8e86bd3e9dd21 |
| SimHash | 4414d95390ea |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /news/ |
| Disallow | /jp/k/ |
| Disallow | /index.php/ |
| Disallow | /a/* |
| Disallow | /ja/forward/ |
| Disallow | /en/forward/ |
| Disallow | /ja/purchase/forward/ |
| Disallow | /en/purchase/forward/ |
| Disallow | /ja/events/*/*/ |
| Disallow | /purchase/g/* |
| Disallow | /*.csv$ |
| Disallow | /en/deck/download/* |
| Disallow | /ja/deck/download/* |
| Disallow | /ja/deck/bulk/* |
| Disallow | /en/deck/bulk/* |
| Disallow | /ja/deck/result?* |
| Disallow | /en/deck/result?* |
| Disallow | /ja/events/list?*page=* |
| Disallow | /en/events/list?*page=* |
| Disallow | /ja/products/search?*page=* |
| Disallow | /ja/products/search?*sort=* |
| Disallow | /ja/products/search?*order=* |
| Disallow | /en/products/search?*page=* |
| Disallow | /en/products/search?*sort=* |
| Disallow | /en/products/search?*order=* |
| Disallow | /ja/purchase/search?*page=* |
| Disallow | /ja/purchase/search?*sort=* |
| Disallow | /ja/purchase/search?*order=* |
| Disallow | /en/purchase/search?*page=* |
| Disallow | /en/purchase/search?*sort=* |
| Disallow | /en/purchase/search?*order=* |
| Disallow | /gftesogvtnsbvv.html/ |
| Disallow | /Sitemap*/ |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /news/ |
| Disallow | /jp/k/ |
| Disallow | /index.php/ |
| Disallow | /a/* |
| Disallow | /ja/forward/ |
| Disallow | /en/forward/ |
| Disallow | /ja/purchase/forward/ |
| Disallow | /en/purchase/forward/ |
| Disallow | /ja/events/*/*/ |
| Disallow | /purchase/g/* |
| Disallow | /*.csv$ |
| Disallow | /en/deck/download/* |
| Disallow | /ja/deck/download/* |
| Disallow | /ja/deck/bulk/* |
| Disallow | /en/deck/bulk/* |
| Disallow | /ja/deck/result?* |
| Disallow | /en/deck/result?* |
| Disallow | /ja/events/list?*page=* |
| Disallow | /en/events/list?*page=* |
| Disallow | /ja/products/search?*page=* |
| Disallow | /ja/products/search?*sort=* |
| Disallow | /ja/products/search?*order=* |
| Disallow | /en/products/search?*page=* |
| Disallow | /en/products/search?*sort=* |
| Disallow | /en/products/search?*order=* |
| Disallow | /ja/purchase/search?*page=* |
| Disallow | /ja/purchase/search?*sort=* |
| Disallow | /ja/purchase/search?*order=* |
| Disallow | /en/purchase/search?*page=* |
| Disallow | /en/purchase/search?*sort=* |
| Disallow | /en/purchase/search?*order=* |
| Disallow | /gftesogvtnsbvv.html/ |
| Disallow | /Sitemap*/ |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /ja/forward/ |
| Disallow | /en/forward/ |
| Disallow | /ja/purchase/forward/ |
| Disallow | /en/purchase/forward/ |
| Disallow | /jp/g/ |
| Disallow | /en/g/ |
| Disallow | /en/k/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
dotbot
| Rule | Path |
|---|---|
| Disallow | /ja/forward/ |
| Disallow | /en/forward/ |
| Disallow | /ja/purchase/forward/ |
| Disallow | /en/purchase/forward/ |
| Disallow | /jp/g/ |
| Disallow | /en/g/ |
| Disallow | /en/k/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
mappy
| Rule | Path |
|---|---|
| Disallow | /ja/forward/ |
| Disallow | /en/forward/ |
| Disallow | /ja/purchase/forward/ |
| Disallow | /en/purchase/forward/ |
| Disallow | /jp/g/ |
| Disallow | /en/g/ |
| Disallow | /en/k/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /ja/forward/ |
| Disallow | /en/forward/ |
| Disallow | /ja/purchase/forward/ |
| Disallow | /en/purchase/forward/ |
| Disallow | /jp/g/ |
| Disallow | /en/g/ |
| Disallow | /en/k/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
semrushbot
| Rule | Path |
|---|---|
| Disallow | /ja/forward/ |
| Disallow | /en/forward/ |
| Disallow | /ja/purchase/forward/ |
| Disallow | /en/purchase/forward/ |
| Disallow | /jp/g/ |
| Disallow | /en/g/ |
| Disallow | /en/k/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hareruyamtg.com/sitemap.xml |
Warnings
- 2 invalid lines.