providentestate.com
robots.txt

Robots Exclusion Standard data for providentestate.com

Resource Scan

Scan Details

Site Domain providentestate.com
Base Domain providentestate.com
Scan Status Ok
Last Scan2024-09-25T14:09:10+00:00
Next Scan 2024-10-02T14:09:10+00:00

Last Scan

Scanned2024-09-25T14:09:10+00:00
URL https://providentestate.com/robots.txt
Redirect https://www.providentestate.com/robots.txt
Redirect Domain www.providentestate.com
Redirect Base providentestate.com
Domain IPs 75.2.60.5
Redirect IPs 13.251.96.10, 18.139.194.139, 2406:da18:880:3802::c8, 2406:da18:b3d:e200::64
Response IP 18.139.194.139
Found Yes
Hash 1f83d1570615b0809c89cd3686cdf09f921a95ab6f22f217007f3345126908a3
SimHash cd108416cf13

Groups

*

Rule Path
Disallow /email/
Disallow /sortby-price-desc/
Disallow /sortby-price-asc/
Disallow /with-amenities-
Disallow /from-
Disallow /under
Disallow /above-
Disallow /between
Disallow /below
Disallow /work-in-progress
Disallow *.cdn.providentestate.com
Disallow *.cdn3.providentestate.com
Disallow /*?*
Allow /favicon-32x32.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-48x48.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-72x72.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-96x96.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-144x144.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-192x192.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-256x256.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-384x384.png?v=4ca6b6490aa753d5671ea4dae0713cfb
Allow /icons/icon-512x512.png?v=4ca6b6490aa753d5671ea4dae0713cfb

Other Records

Field Value
sitemap https://www.providentestate.com/sitemap.xml

Warnings

  • `host` is not a known field.