sapporo-mn.jugem.jp
robots.txt
Robots Exclusion Standard data for sapporo-mn.jugem.jp
Resource Scan
Scan Details
Site Domain | sapporo-mn.jugem.jp |
Base Domain | jugem.jp |
Scan Status | Ok |
Last Scan | 2024-10-29T08:12:47+00:00 |
Next Scan | 2024-11-28T08:12:47+00:00 |
Last Scan
Scanned | 2024-10-29T08:12:47+00:00 |
URL | https://sapporo-mn.jugem.jp/robots.txt |
Domain IPs | 52.193.42.37 |
Response IP | 52.193.42.37 |
Found | Yes |
Hash | 2cebf945cdc865959d77e8e3748bde83e5e83422d6ccdccdaed07589cd3ee3f6 |
SimHash | 6208c2020373 |
Groups
bingbot
Rule | Path |
---|---|
Disallow | /?month* |
Disallow | /?day* |
Disallow | /?cid* |
Disallow | /?search* |
Disallow | /template* |
Disallow | /jm_style.css |
Disallow | /manage* |
Disallow | /admin* |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
*
Rule | Path |
---|---|
Allow | / |
Disallow | /manage* |
Disallow | /admin* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |