sapporo-mn.jugem.jp
robots.txt

Robots Exclusion Standard data for sapporo-mn.jugem.jp

Resource Scan

Scan Details

Site Domain sapporo-mn.jugem.jp
Base Domain jugem.jp
Scan Status Ok
Last Scan2024-08-30T08:09:25+00:00
Next Scan 2024-09-29T08:09:25+00:00

Last Scan

Scanned2024-08-30T08:09:25+00:00
URL https://sapporo-mn.jugem.jp/robots.txt
Domain IPs 52.193.42.37
Response IP 52.193.42.37
Found Yes
Hash 2cebf945cdc865959d77e8e3748bde83e5e83422d6ccdccdaed07589cd3ee3f6
SimHash 6208c2020373

Groups

bingbot

Rule Path
Disallow /?month*
Disallow /?day*
Disallow /?cid*
Disallow /?search*
Disallow /template*
Disallow /jm_style.css
Disallow /manage*
Disallow /admin*

Other Records

Field Value
crawl-delay 30

*

Rule Path
Allow /
Disallow /manage*
Disallow /admin*

Other Records

Field Value
crawl-delay 10