realtyaustin.com
robots.txt
Robots Exclusion Standard data for realtyaustin.com
Resource Scan
Scan Details
Site Domain | realtyaustin.com |
Base Domain | realtyaustin.com |
Scan Status | Ok |
Last Scan | 2024-04-19T10:50:24+00:00 |
Next Scan | 2024-05-19T10:50:24+00:00 |
Last Scan
Scanned | 2024-04-19T10:50:24+00:00 |
URL | https://realtyaustin.com/robots.txt |
Redirect | https://www.realtyaustin.com:443/robots.txt |
Redirect Domain | www.realtyaustin.com |
Redirect Base | realtyaustin.com |
Domain IPs | 3.160.188.105, 3.160.188.28, 3.160.188.37, 3.160.188.70 |
Redirect IPs | 3.160.188.105, 3.160.188.28, 3.160.188.37, 3.160.188.70 |
Response IP | 18.165.171.85 |
Found | Yes |
Hash | f5422fa6e7cf2668f1bbc1463dd790a108f402277221c586b9cb31b551bcbe61 |
SimHash | e1811e0cab97 |
Groups
*
Rule | Path |
---|---|
Disallow | /privacy-policy |
Disallow | /terms-of-use |
Disallow | /agents/*/contact |
Disallow | /menu |
Disallow | /listings/lease |
Disallow | /p/ |
Disallow | /t/ |
Disallow | /media-whitepapers/ |
Disallow | /listings/market-overview/custom/* |
Disallow | /listings/custom/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.realtyaustin.com/sitemap.xml |