Log In Sign Up

irumah.co
robots.txt

Robots Exclusion Standard data for irumah.co

Resource Scan

Scan Details

Site Domain irumah.co
Base Domain irumah.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-15T11:45:43+00:00
Next Scan 2026-02-13T11:45:43+00:00

Last Successful Scan

Scanned2025-10-16T04:32:24+00:00
URL https://irumah.co/robots.txt
Domain IPs 52.221.111.113, 52.76.198.198
Response IP 52.76.198.198
Found Yes
Hash e939d9cfaab7018b70240e98a3b01d3a8d1ef82061002eeb74651cd006c92498
SimHash d316d140e808

Groups

*

Rule Path
Disallow /halt
Disallow /login
Disallow /bm/halt
Disallow /bm/login

ahrefsbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bingbot

Rule Path
Disallow /listings/
Disallow /bm/listings/

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-webindexer

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /listings/
Disallow /bm/listings/

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

spbot

Rule Path
Disallow /
Back to top