pds.exblog.jp
robots.txt

Robots Exclusion Standard data for pds.exblog.jp

Resource Scan

Scan Details

Site Domain pds.exblog.jp
Base Domain exblog.jp
Scan Status Ok
Last Scan2025-04-01T17:17:35+00:00
Next Scan 2025-05-01T17:17:35+00:00

Last Scan

Scanned2025-04-01T17:17:35+00:00
URL https://pds.exblog.jp/robots.txt
Domain IPs 13.35.238.28, 13.35.238.3, 13.35.238.32, 13.35.238.91
Response IP 13.35.238.28
Found Yes
Hash e33b54e7dd6d0e77748f6b7f3cd0fc4014ddeec2059ce87f25ed401364c91c29
SimHash c33dca72a33b

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

megaindex

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /