Log In Sign Up

housedo.co.jp
robots.txt

Robots Exclusion Standard data for housedo.co.jp

Resource Scan

Scan Details

Site Domain housedo.co.jp
Base Domain housedo.co.jp
Scan Status Ok
Last Scan2025-05-02T12:45:00+00:00
Next Scan 2025-06-01T12:45:00+00:00

Last Scan

Scanned2025-05-02T12:45:00+00:00
URL https://housedo.co.jp/robots.txt
Redirect https://www.housedo.co.jp:443/robots.txt
Redirect Domain www.housedo.co.jp
Redirect Base housedo.co.jp
Domain IPs 18.180.44.253, 35.76.190.64
Redirect IPs 18.180.44.253, 35.76.190.64
Response IP 35.76.190.64
Found Yes
Hash 57ad6f43ddac2a610d0684774855bb0bcd7f51358a78f7b787ce821c590adde3
SimHash 427ff463cbc9

Groups

*

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

yetibot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

nabot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

netestate rss crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

steeler

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

lwnutch

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

smrjbot

Rule Path
Disallow /

smrjbot/0.0.20

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

simplepie/1.3.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /
Back to top

Comments

  • User-agent: *
  • Disallow: /_mm/
  • Disallow: /_notes/
  • Disallow: /_baks/
  • Disallow: /MMWIP/
  • Disallow: /fc/document_seikou.pdf
  • Sitemap: http://housedo.co.jp/sitemap.xml
  • User-agent: googlebot
  • Disallow: *.csi
  • Sitemap: http://housedo.co.jp/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top