curranmiller.com
robots.txt

Robots Exclusion Standard data for curranmiller.com

Resource Scan

Scan Details

Site Domain curranmiller.com
Base Domain curranmiller.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-10T10:58:45+00:00
Next Scan 2026-02-17T10:58:45+00:00

Last Successful Scan

Scanned2026-01-08T22:17:09+00:00
URL https://curranmiller.com/robots.txt
Redirect https://www.curranmiller.com/robots.txt
Redirect Domain www.curranmiller.com
Redirect Base curranmiller.com
Domain IPs 104.26.6.198, 104.26.7.198, 172.67.75.113, 2606:4700:20::681a:6c6, 2606:4700:20::681a:7c6, 2606:4700:20::ac43:4b71
Redirect IPs 104.26.6.198, 104.26.7.198, 172.67.75.113, 2606:4700:20::681a:6c6, 2606:4700:20::681a:7c6, 2606:4700:20::ac43:4b71
Response IP 172.67.75.113
Found Yes
Hash 2a951f80ceceafef2ce43856fe98bfd9bc56c81e697b6d13b39d5534464ccbd2
SimHash c017d46ae810

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

tiktokbot

Rule Path
Disallow /

douyinspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

perplexity

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sogou

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax
Disallow /auction/*/document/
Disallow /listing/*/document/
Disallow /rental/*/document/

Other Records

Field Value
sitemap https://www.curranmiller.com/sitemap.xml