oikura.jp
robots.txt

Robots Exclusion Standard data for oikura.jp

Resource Scan

Scan Details

Site Domain oikura.jp
Base Domain oikura.jp
Scan Status Ok
Last Scan2024-06-26T10:12:40+00:00
Next Scan 2024-07-03T10:12:40+00:00

Last Scan

Scanned2024-06-26T10:12:40+00:00
URL https://oikura.jp/robots.txt
Domain IPs 52.197.94.84
Response IP 52.197.94.84
Found Yes
Hash 98ba1c6194ebaafacaba81c874ca7ee43fe8390f59a493f9ab196a07dee2d5e5
SimHash e100b391e2bb

Groups

*

Rule Path
Allow /
Disallow /*?ad=*
Disallow /satei*
Disallow /appraisal*
Disallow /Appraisal*
Disallow /Applex/input/
Disallow /shopUrlMail/
Disallow /news/
Disallow /users/
Disallow /message_errors/
Disallow /client/
Disallow /maintenance/
Disallow /osusume_shop/
Disallow /local/
Disallow /bought/rank/
Allow /message_errors/MessageError/SHOP0025

googlebot-image

Rule Path
Disallow /camp*
Disallow /common/img*
Disallow /guide*
Disallow /img*
Disallow /image*
Disallow /local*
Disallow /lp*
Disallow /news*
Disallow /old*
Disallow /osusume_shop*
Disallow /repair*
Disallow /sateispns*
Disallow /shichi*
Disallow /souko*
Disallow /test*
Disallow /topics*

googlebot-mobile

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

ahrefsbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap http://oikura.jp/sitemap_1.xml