providentestate.com
robots.txt
Robots Exclusion Standard data for providentestate.com
Resource Scan
Scan Details
Site Domain | providentestate.com |
Base Domain | providentestate.com |
Scan Status | Ok |
Last Scan | 2024-09-25T14:09:10+00:00 |
Next Scan | 2024-10-02T14:09:10+00:00 |
Last Scan
Scanned | 2024-09-25T14:09:10+00:00 |
URL | https://providentestate.com/robots.txt |
Redirect | https://www.providentestate.com/robots.txt |
Redirect Domain | www.providentestate.com |
Redirect Base | providentestate.com |
Domain IPs | 75.2.60.5 |
Redirect IPs | 13.251.96.10, 18.139.194.139, 2406:da18:880:3802::c8, 2406:da18:b3d:e200::64 |
Response IP | 18.139.194.139 |
Found | Yes |
Hash | 1f83d1570615b0809c89cd3686cdf09f921a95ab6f22f217007f3345126908a3 |
SimHash | cd108416cf13 |
Groups
*
Rule | Path |
---|---|
Disallow | /email/ |
Disallow | /sortby-price-desc/ |
Disallow | /sortby-price-asc/ |
Disallow | /with-amenities- |
Disallow | /from- |
Disallow | /under |
Disallow | /above- |
Disallow | /between |
Disallow | /below |
Disallow | /work-in-progress |
Disallow | *.cdn.providentestate.com |
Disallow | *.cdn3.providentestate.com |
Disallow | /*?* |
Allow | /favicon-32x32.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-48x48.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-72x72.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-96x96.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-144x144.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-192x192.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-256x256.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-384x384.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Allow | /icons/icon-512x512.png?v=4ca6b6490aa753d5671ea4dae0713cfb |
Other Records
Field | Value |
---|---|
sitemap | https://www.providentestate.com/sitemap.xml |
Warnings
- `host` is not a known field.