haritada.com
robots.txt

Robots Exclusion Standard data for haritada.com

Resource Scan

Scan Details

Site Domain haritada.com
Base Domain haritada.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-01T14:14:40+00:00
Next Scan 2026-01-30T14:14:40+00:00

Last Successful Scan

Scanned2025-07-04T07:48:50+00:00
URL https://www.haritada.com/robots.txt
Domain IPs 51.222.5.11
Response IP 51.222.5.11
Found Yes
Hash d00df4f9485cbfa658d2b38f835660129a5f7d609dc2f8db65d0c1f816c783c3
SimHash 185e4462387a

Groups

spbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

daum

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

admantx

Rule Path
Disallow /

deusu

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /