eslove.jp
robots.txt

Robots Exclusion Standard data for eslove.jp

Resource Scan

Scan Details

Site Domain eslove.jp
Base Domain eslove.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-12T00:11:31+00:00
Next Scan 2025-01-10T00:11:31+00:00

Last Successful Scan

Scanned2024-05-23T00:06:19+00:00
URL https://eslove.jp/robots.txt
Domain IPs 34.149.210.45
Response IP 34.149.210.45
Found Yes
Hash 8d6ac67448380edb3b5391476249084a5ed01679e7fa97a0900665a52d8d4c25
SimHash 625ec42083a0

Groups

velenpublicwebcrawler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /