housedo.com
robots.txt

Robots Exclusion Standard data for housedo.com

Resource Scan

Scan Details

Site Domain housedo.com
Base Domain housedo.com
Scan Status Ok
Last Scan2024-09-04T22:24:58+00:00
Next Scan 2024-10-04T22:24:58+00:00

Last Scan

Scanned2024-09-04T22:24:58+00:00
URL https://housedo.com/robots.txt
Redirect https://www.housedo.com/robots.txt
Redirect Domain www.housedo.com
Redirect Base housedo.com
Domain IPs 13.113.144.60, 52.69.39.6
Redirect IPs 13.113.144.60, 52.69.39.6
Response IP 52.69.39.6
Found Yes
Hash 6f292ad8914c78157d8d476c8abbd5adde30a869152e9bd01ceaa8eb13f3871d
SimHash 3a4ef442c3a9

Groups

*

Rule Path
Disallow /APC/
Disallow /bundles/
Disallow /cacheJson/
Disallow /components/
Disallow /LP/
Disallow /mtapp/
Disallow /seoFiles/
Disallow /forms/lbInquiry/input/?type=hlb_fj
Disallow /s/forms/lbInquiry/input/?type=hlb_fj
Disallow /img/ieurikai/news/

bingbot

Rule Path
Disallow /APC/
Disallow /bundles/
Disallow /cacheJson/
Disallow /components/
Disallow /LP/
Disallow /mtapp/
Disallow /seoFiles/

Other Records

Field Value
crawl-delay 60

slurp

Rule Path
Disallow /APC/
Disallow /bundles/
Disallow /cacheJson/
Disallow /components/
Disallow /LP/
Disallow /mtapp/
Disallow /seoFiles/

Other Records

Field Value
crawl-delay 3

msnbot

Rule Path
Disallow /APC/
Disallow /bundles/
Disallow /cacheJson/
Disallow /components/
Disallow /LP/
Disallow /mtapp/
Disallow /seoFiles/

Other Records

Field Value
crawl-delay 60

msnbot-media

Rule Path
Disallow /APC/
Disallow /bundles/
Disallow /cacheJson/
Disallow /components/
Disallow /LP/
Disallow /mtapp/
Disallow /seoFiles/

Other Records

Field Value
crawl-delay 60

teoma

Rule Path
Disallow /APC/
Disallow /bundles/
Disallow /cacheJson/
Disallow /components/
Disallow /LP/
Disallow /mtapp/
Disallow /seoFiles/

Other Records

Field Value
crawl-delay 600

yandex

Rule Path
Disallow /APC/
Disallow /bundles/
Disallow /cacheJson/
Disallow /components/
Disallow /LP/
Disallow /mtapp/
Disallow /seoFiles/

Other Records

Field Value
crawl-delay 600

yetibot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

nabot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

netestate rss crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

steeler

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

lwnutch

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

smrjbot

Rule Path
Disallow /

smrjbot/0.0.20

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

simplepie/1.3.1

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

linespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.housedo.com/sitemap.xml

Warnings

  • 4 invalid lines.