e-butsudan.com
robots.txt

Robots Exclusion Standard data for e-butsudan.com

Resource Scan

Scan Details

Site Domain e-butsudan.com
Base Domain e-butsudan.com
Scan Status Ok
Last Scan2024-09-16T05:01:46+00:00
Next Scan 2024-09-23T05:01:46+00:00

Last Scan

Scanned2024-09-16T05:01:46+00:00
URL https://e-butsudan.com/robots.txt
Redirect https://www.e-butsudan.com:443/robots.txt
Redirect Domain www.e-butsudan.com
Redirect Base e-butsudan.com
Domain IPs 13.33.30.3, 13.33.30.6, 13.33.30.66, 13.33.30.96
Redirect IPs 13.33.30.3, 13.33.30.6, 13.33.30.66, 13.33.30.96
Response IP 13.33.30.6
Found Yes
Hash 42b56a324c9d5d44dfe817aeed8b1863fbfaee197468f62e7850abf1a759cc56
SimHash 387ed9c088a1

Groups

*

Rule Path
Disallow /tools/
Disallow /back_admin/
Disallow /shopadmin/
Disallow /*.pdf$
Disallow /*/shop_coupon_
Disallow /*/shop_raiten_
Disallow /*/shop_catalog_
Disallow /*/shop_online_

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

ask jeeves

Rule Path
Disallow /

listran

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.e-butsudan.com/sitemap.xml
sitemap https://www.e-butsudan.com/sitemap2.xml
sitemap https://www.e-butsudan.com/sitemap3.xml
sitemap https://www.e-butsudan.com/sitemap4.xml
sitemap https://www.e-butsudan.com/sp/sitemap.xml
sitemap https://www.e-butsudan.com/sp/sitemap2.xml
sitemap https://www.e-butsudan.com/sp/sitemap3.xml
sitemap https://www.e-butsudan.com/sp/sitemap4.xml

Warnings

  • 2 invalid lines.