roglegend.com
robots.txt

Robots Exclusion Standard data for roglegend.com

Resource Scan

Scan Details

Site Domain roglegend.com
Base Domain roglegend.com
Scan Status Ok
Last Scan2025-11-08T15:37:58+00:00
Next Scan 2025-12-08T15:37:58+00:00

Last Scan

Scanned2025-11-08T15:37:58+00:00
URL https://roglegend.com/robots.txt
Domain IPs 52.52.24.52, 52.9.101.47
Response IP 52.52.24.52
Found Yes
Hash a7ff2403d0639635132d0ea018d8abbe9a5cb7ba4d3dedfa5ef4b3734b87caba
SimHash c15c4c422a91

Groups

*

Rule Path
Disallow /admin/
Disallow /logout
Disallow /*login*
Disallow /0.gif*
Disallow /api-graphql/loginInfo
Disallow /api-site/getLeadAccid
Disallow /api-site/getWalkScore
Disallow /api/chatbot/*
Disallow /user/get-user
Disallow */autodiscover/autodiscover.xml
Disallow /open-api/mls/trans/closely/white-list
Disallow /html-app/*
Disallow /api/adsplatform/conversion/event
Disallow /api-hj/hj-data/v1/boundary
Disallow /api-site/marketreport/v1/area/overview
Disallow /18f00cbc922baws932d8b0key1095

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://roglegend.com/sitemap.xml