bookbang.jp
robots.txt

Robots Exclusion Standard data for bookbang.jp

Resource Scan

Scan Details

Site Domain bookbang.jp
Base Domain bookbang.jp
Scan Status Ok
Last Scan2024-11-17T01:10:58+00:00
Next Scan 2024-11-24T01:10:58+00:00

Last Scan

Scanned2024-11-17T01:10:58+00:00
URL https://bookbang.jp/robots.txt
Redirect https://www.bookbang.jp/robots.txt
Redirect Domain www.bookbang.jp
Redirect Base bookbang.jp
Domain IPs 104.22.64.202, 104.22.65.202, 172.67.25.60, 2606:4700:10::6816:40ca, 2606:4700:10::6816:41ca, 2606:4700:10::ac43:193c
Redirect IPs 104.22.64.202, 104.22.65.202, 172.67.25.60, 2606:4700:10::6816:40ca, 2606:4700:10::6816:41ca, 2606:4700:10::ac43:193c
Response IP 172.67.25.60
Found Yes
Hash 5e99c82e01ca3e5c88ea4941ffd8251120f05f64ad61a5dae83f6c5c553bfa14
SimHash 921dc8a0e69a

Groups

dotbot
ahrefsbot
blexbot
mj12bot
linguee
proximic
grapeshotcrawler
semrushbot
dataforseobot
trendictionbot
megaindex
tinytestbot
thesis-research-bot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30