property.whitepages.com
robots.txt

Robots Exclusion Standard data for property.whitepages.com

Resource Scan

Scan Details

Site Domain property.whitepages.com
Base Domain whitepages.com
Scan Status Ok
Last Scan2026-03-09T07:37:08+00:00
Next Scan 2026-04-08T07:37:08+00:00

Last Scan

Scanned2026-03-09T07:37:08+00:00
URL https://property.whitepages.com/robots.txt
Domain IPs 104.18.41.32, 172.64.146.224, 2a06:98c1:3109::6812:2920, 2a06:98c1:310a::ac40:92e0
Response IP 104.18.41.32
Found Yes
Hash 2f5bf39a5234c408b58340cd1bcfa7d1f8a20df2488ddba108261acdc0b7b0ea
SimHash 0a089433830a

Groups

*

Rule Path
Allow /property-search
Allow /property
Allow /guides
Allow /compare
Allow /ads.txt
Allow /apple-touch-icon.png
Allow /favicon.ico$
Allow /llm.txt
Allow /chatbot
Allow /privacy
Allow /images
Allow /styles/
Allow *.xml$
Allow *.xml.gz$
Allow /$
Allow /?
Disallow /
Disallow *?redirectedProperty=
Disallow *?bbox=
Disallow *?
Disallow /property-feed
Disallow /property-search/nextdoor

Other Records

Field Value
sitemap https://property.whitepages.com/sitemap-city.xml
sitemap https://property.whitepages.com/sitemap-city-vacant.xml
sitemap https://property.whitepages.com/sitemap-city-single-family.xml
sitemap https://property.whitepages.com/sitemap-zip-code.xml
sitemap https://property.whitepages.com/sitemap-county.xml
sitemap https://property.whitepages.com/sitemap-state.xml