Log In Sign Up

ml.ameblo.jp
robots.txt

Robots Exclusion Standard data for ml.ameblo.jp

Resource Scan

Scan Details

Site Domain ml.ameblo.jp
Base Domain ameblo.jp
Scan Status Ok
Last Scan2024-11-03T14:00:34+00:00
Next Scan 2024-11-17T14:00:34+00:00

Last Scan

Scanned2024-11-03T14:00:34+00:00
URL https://ml.ameblo.jp/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 199.232.45.91
Found Yes
Hash ac290054b6fad967ebfeea6a6869a8574bb2be106953b947b5fc30501f6dc363
SimHash 65b5855585f5

Groups

googlebot

Rule Path
Disallow /api
Disallow /embed
Disallow /products
Allow /shops/
Disallow /shops/*/*

bingbot

Rule Path
Disallow /api
Disallow /embed
Disallow /products
Allow /shops/
Disallow /shops/*/*

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://ml.ameblo.jp/sitemap.xml
Back to top