propertyhub.us
robots.txt

Robots Exclusion Standard data for propertyhub.us

Resource Scan

Scan Details

Site Domain propertyhub.us
Base Domain propertyhub.us
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-13T05:59:52+00:00
Next Scan 2025-06-12T05:59:52+00:00

Last Successful Scan

Scanned2025-02-13T05:49:26+00:00
URL https://propertyhub.us/robots.txt
Domain IPs 104.21.80.209, 172.67.153.210, 2606:4700:3030::ac43:99d2, 2606:4700:3033::6815:50d1
Response IP 172.67.153.210
Found Yes
Hash fce8e785b3cf7feb9c3144e3a7400028b6b18d23d8ddadd3dd9c12f74fd0fb3a
SimHash 29043344c191

Groups

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

*

Rule Path
Disallow /oc-admin/
Disallow /display/
Disallow /adpointer/
Disallow *q%3D%2C*
Disallow *contact?v=*
Disallow *sShowAs*
Disallow *sOrder%2Ci_price*
Disallow *iPage*
Disallow *item/mark*
Disallow *item/send-friend*
Disallow *item-prev*
Disallow *item-next*
Disallow *page%3Dajax*
Disallow *install.css*
Disallow *ShowSearchMeta%2CShow*
Disallow *lngp*
Disallow *languages*
Disallow *maoin.ie*maoin.ie*
Disallow *ie/maoin.ie*
Disallow *realtyww.info*maoin.ie*
Disallow *category%2C*category%2C*
Disallow *country%2C*country%2C*
Disallow *city%2C*city%2C*
Disallow *category%2Cuk%2B*
Disallow *category%2Cd%2Bsearch%2B*
Disallow *category%2C*thumbnail.jpg*
Disallow *category%2C*-r*
Disallow *category%2C*-c*
Disallow *category%2C*_i*
Disallow *category%2C*_lid*

bingbot

Rule Path
Disallow *sFeed%2Crss*
Disallow *map-img*

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://propertyhub.us/map-cit
sitemap https://propertyhub.us/map-img
sitemap https://propertyhub.us/map-latest