withnews.jp
robots.txt
Robots Exclusion Standard data for withnews.jp
Resource Scan
Scan Details
| Site Domain | withnews.jp |
| Base Domain | withnews.jp |
| Scan Status | Ok |
| Last Scan | 2024-11-08T17:57:19+00:00 |
| Next Scan | 2024-11-15T17:57:19+00:00 |
Last Scan
| Scanned | 2024-11-08T17:57:19+00:00 |
| URL | https://withnews.jp/robots.txt |
| Domain IPs | 13.33.88.105, 13.33.88.25, 13.33.88.41, 13.33.88.90 |
| Response IP | 13.33.88.41 |
| Found | Yes |
| Hash | 6a506a58aff84d61dbd4fb9032f0218d2a6dd60189608d43bc17f5c1a666cf66 |
| SimHash | 28219e708d9b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /login |
| Disallow | /mypage |
| Disallow | /settings |
| Disallow | /404 |
| Disallow | /api |
Other Records
| Field | Value |
|---|---|
| sitemap | http://withnews.jp/sitemap.xml |
| sitemap | http://withnews.jp/sitemapnews.xml |