preferredagents.com
robots.txt

Robots Exclusion Standard data for preferredagents.com

Resource Scan

Scan Details

Site Domain preferredagents.com
Base Domain preferredagents.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-03T20:42:24+00:00
Next Scan 2025-12-02T20:42:24+00:00

Last Successful Scan

Scanned2025-01-14T20:32:12+00:00
URL https://www.preferredagents.com/robots.txt
Domain IPs 52.52.24.52, 52.9.101.47
Response IP 52.52.24.52
Found Yes
Hash 9350d4f8c326e462baa0fd4e24db4de93cdc0041c9185ebf7e6071d8e95c6515
SimHash c81c4c42ba93

Groups

*

Rule Path
Disallow /admin/
Disallow /logout
Disallow /*login*
Disallow /0.gif*
Disallow /api-graphql/loginInfo
Disallow /api-site/getLeadAccid
Disallow /api-site/getWalkScore
Disallow /api/chatbot/*
Disallow /user/get-user
Disallow */autodiscover/autodiscover.xml
Disallow /open-api/mls/trans/closely/white-list
Disallow /html-app/*
Disallow /api/adsplatform/conversion/event
Disallow /api-hj/hj-data/v1/boundary
Disallow /api-site/marketreport/v1/area/overview
Disallow /18f00cbc922baws932d8b0key1095
Disallow /house-listing

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.preferredagents.com/sitemap.xml