marklawter.com
robots.txt

Robots Exclusion Standard data for marklawter.com

Resource Scan

Scan Details

Site Domain marklawter.com
Base Domain marklawter.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-17T15:37:13+00:00
Next Scan 2025-11-16T15:37:13+00:00

Last Successful Scan

Scanned2025-08-25T12:07:41+00:00
URL https://www.marklawter.com/robots.txt
Domain IPs 52.52.24.52, 52.9.101.47
Response IP 52.9.101.47
Found Yes
Hash d2e96e1743f45c021483dc46483e2b557aeef2f4066909cc082a13d89b7ec477
SimHash c15c4c423a91

Groups

*

Rule Path
Disallow /admin/
Disallow /logout
Disallow /*login*
Disallow /0.gif*
Disallow /api-graphql/loginInfo
Disallow /api-site/getLeadAccid
Disallow /api-site/getWalkScore
Disallow /api/chatbot/*
Disallow /user/get-user
Disallow */autodiscover/autodiscover.xml
Disallow /open-api/mls/trans/closely/white-list
Disallow /html-app/*
Disallow /api/adsplatform/conversion/event
Disallow /api-hj/hj-data/v1/boundary
Disallow /api-site/marketreport/v1/area/overview
Disallow /18f00cbc922baws932d8b0key1095

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.marklawter.com/sitemap.xml