freem.ne.jp
robots.txt
Robots Exclusion Standard data for freem.ne.jp
Resource Scan
Scan Details
| Site Domain | freem.ne.jp |
| Base Domain | freem.ne.jp |
| Scan Status | Ok |
| Last Scan | 2024-06-25T16:56:13+00:00 |
| Next Scan | 2024-07-02T16:56:13+00:00 |
Last Scan
| Scanned | 2024-06-25T16:56:13+00:00 |
| URL | https://freem.ne.jp/robots.txt |
| Redirect | https://www.freem.ne.jp/robots.txt |
| Redirect Domain | www.freem.ne.jp |
| Redirect Base | freem.ne.jp |
| Domain IPs | 160.16.73.74 |
| Redirect IPs | 160.16.73.74 |
| Response IP | 160.16.73.74 |
| Found | Yes |
| Hash | d80b07888cb0046b86d0017e01cb817ca13f1c8789b5f65a7b445d20806b9f1f |
| SimHash | ec5450ab6b5b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dl/download/ |
| Disallow | /dl/members_dl/ |
| Disallow | /browser/start_game_new/ |
| Disallow | /account/ |
| Disallow | /mypage/ |
| Disallow | /creator/ |
| Disallow | /creator_illust/ |
| Disallow | /stock_cart/ |