bizocean.jp
robots.txt

Robots Exclusion Standard data for bizocean.jp

Resource Scan

Scan Details

Site Domain bizocean.jp
Base Domain bizocean.jp
Scan Status Ok
Last Scan2024-11-16T22:02:42+00:00
Next Scan 2024-11-23T22:02:42+00:00

Last Scan

Scanned2024-11-16T22:02:42+00:00
URL https://bizocean.jp/robots.txt
Redirect https://www.bizocean.jp/robots.txt
Redirect Domain www.bizocean.jp
Redirect Base bizocean.jp
Domain IPs 34.149.212.222
Redirect IPs 34.149.212.222
Response IP 34.149.212.222
Found Yes
Hash d73f5fc5ae266f70e262d51569c8dc25651b83df51177a4fe8627d349717e31c
SimHash 401d949172f4

Groups

googlebot

Rule Path
Allow /
Disallow /oceanus/
Disallow /*order
Disallow /*tile
Disallow /*yahoo
Disallow /*mode
Disallow /*gclid
Disallow /*yclid
Disallow /*pageno

*

Rule Path
Disallow /.php
Disallow /_develop
Disallow /_include
Disallow /api

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seekportbot

Rule Path
Disallow /