mag2.com
robots.txt
Robots Exclusion Standard data for mag2.com
Resource Scan
Scan Details
| Site Domain | mag2.com |
| Base Domain | mag2.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T18:43:59+00:00 |
| Next Scan | 2024-09-27T18:43:59+00:00 |
Last Scan
| Scanned | 2024-09-20T18:43:59+00:00 |
| URL | https://www.mag2.com/robots.txt |
| Domain IPs | 13.33.88.22, 13.33.88.35, 13.33.88.55, 13.33.88.79 |
| Response IP | 13.33.88.22 |
| Found | Yes |
| Hash | 7b55f0affe7c7d7a37bdb43f390d9a4d4c34f08da01faebec4e3b05ef69e1d12 |
| SimHash | f92d581105b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /test/ |
| Disallow | /sample/ |
| Disallow | /p/money/mailmagazine/kinyukeizai_journal/ |
| Disallow | /p/money/hikaku/ |
| Disallow | /MagSearch.do?keyword=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mag2.com/sitemaps/www.001.sitemap.xml |