propertypal.com
robots.txt

Robots Exclusion Standard data for propertypal.com

Resource Scan

Scan Details

Site Domain propertypal.com
Base Domain propertypal.com
Scan Status Ok
Last Scan2024-05-30T20:37:13+00:00
Next Scan 2024-06-06T20:37:13+00:00

Last Scan

Scanned2024-05-30T20:37:13+00:00
URL https://propertypal.com/robots.txt
Redirect https://www.propertypal.com/robots.txt
Redirect Domain www.propertypal.com
Redirect Base propertypal.com
Domain IPs 104.22.32.118, 104.22.33.118, 172.67.10.106, 2606:4700:10::6816:2076, 2606:4700:10::6816:2176, 2606:4700:10::ac43:a6a
Redirect IPs 104.22.32.118, 104.22.33.118, 172.67.10.106, 2606:4700:10::6816:2076, 2606:4700:10::6816:2176, 2606:4700:10::ac43:a6a
Response IP 172.67.10.106
Found Yes
Hash 1d62e0f326c9dc8925eae0b441f816ffcf150fc789c07226b9728616d61d7a58
SimHash e8d2da128bc6

Groups

*

Rule Path
Disallow /search
Disallow /premium/featured-property/*
Disallow /premium/premier-listing/*
Disallow /premium/checkout
Disallow /letting-agent-fees
Disallow /letting-agent-fees/*
Disallow /return-on-investment
Disallow /commercial-terms
Disallow /cdn-cgi/*
Disallow /user/*
Disallow /my/*
Disallow /map/*
Disallow /*/*/map
Disallow /*/*/gallery
Disallow /*/*/slideshow
Disallow /*/*/tour1
Disallow /*/*/tour2
Disallow /*/*/video1
Disallow /*/*/video2
Disallow /*/*/enquiry
Disallow /*/*/stamp-duty
Disallow /*/*/share
Disallow /*/*/promote
Disallow /lightbox/*
Disallow /wapi/*
Disallow /save-search
Disallow /property-print

mediapartners-google*

Rule Path
Disallow

gurujibot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou pic spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

oozbot

Rule Path
Disallow /

tagoobot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.propertypal.com/sitemap.xml

Warnings

  • 2 invalid lines.