atmarkit.co.jp
robots.txt
Robots Exclusion Standard data for atmarkit.co.jp
Resource Scan
Scan Details
| Site Domain | atmarkit.co.jp |
| Base Domain | atmarkit.co.jp |
| Scan Status | Ok |
| Last Scan | 2025-12-26T07:33:35+00:00 |
| Next Scan | 2026-01-02T07:33:35+00:00 |
Last Scan
| Scanned | 2025-12-26T07:33:35+00:00 |
| URL | https://www.atmarkit.co.jp/robots.txt |
| Redirect | https://atmarkit.itmedia.co.jp/robots.txt |
| Redirect Domain | atmarkit.itmedia.co.jp |
| Redirect Base | itmedia.co.jp |
| Domain IPs | 3.113.75.152, 52.68.246.121 |
| Redirect IPs | 13.159.195.76, 52.198.118.164 |
| Response IP | 13.159.195.76 |
| Found | Yes |
| Hash | 87ad7f943769006fef7ae23c630ae077374de2969736b9d0bdd7d2893a95a345 |
| SimHash | 23c4dc54ed70 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /servlets/ | prevent robots from crawling servlet-based dynamic pages |
| Disallow | /botsv/ | - |
| Disallow | /bbs/phpBB/bb_profile.php | - |
| Disallow | /bbs/phpBB/editpost.php | - |
| Disallow | /bbs/phpBB/newtopic.php | - |
| Disallow | /bbs/phpBB/sendpmsg.php | - |
| Disallow | /bbs/phpBB/topicadmin.php | - |
| Disallow | /bbs/phpBB/reply.php | - |
| Disallow | /club/print/print.php | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://atmarkit.itmedia.co.jp/ait/google_sitemap_index.xml |
| sitemap | https://atmarkit.itmedia.co.jp/googlenews_sitemap.xml |