mtg.gr.jp
robots.txt
Robots Exclusion Standard data for mtg.gr.jp
Resource Scan
Scan Details
| Site Domain | mtg.gr.jp |
| Base Domain | mtg.gr.jp |
| Scan Status | Ok |
| Last Scan | 2024-10-26T23:54:16+00:00 |
| Next Scan | 2024-11-25T23:54:16+00:00 |
Last Scan
| Scanned | 2024-10-26T23:54:16+00:00 |
| URL | https://mtg.gr.jp/robots.txt |
| Redirect | https://www.mtg.gr.jp/robots.txt |
| Redirect Domain | www.mtg.gr.jp |
| Redirect Base | mtg.gr.jp |
| Domain IPs | 111.171.218.67 |
| Redirect IPs | 18.155.68.119, 18.155.68.68, 18.155.68.79, 18.155.68.96, 2600:9000:23d2:4400:9:9290:9740:93a1, 2600:9000:23d2:5000:9:9290:9740:93a1, 2600:9000:23d2:5600:9:9290:9740:93a1, 2600:9000:23d2:800:9:9290:9740:93a1, 2600:9000:23d2:8200:9:9290:9740:93a1, 2600:9000:23d2:8600:9:9290:9740:93a1, 2600:9000:23d2:e200:9:9290:9740:93a1, 2600:9000:23d2:e600:9:9290:9740:93a1 |
| Response IP | 18.155.68.96 |
| Found | Yes |
| Hash | 314296af6bd3911d49428902aaf2ca1f99c35986d67f8a5284b815353baca9a9 |
| SimHash | 9044185443d6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /products/beauty/product/plosion_de_salon/cracking_oil_serum/ |
| Disallow | /brands/beauty/product/plosion_de_salon/cracking_oil_serum/ |
| Disallow | /brands/beauty/product/refa_active/active/ |