real-estate.org.uk
robots.txt

Robots Exclusion Standard data for real-estate.org.uk

Resource Scan

Scan Details

Site Domain real-estate.org.uk
Base Domain real-estate.org.uk
Scan Status Ok
Last Scan2024-05-18T13:52:17+00:00
Next Scan 2024-05-25T13:52:17+00:00

Last Scan

Scanned2024-05-18T13:52:17+00:00
URL https://real-estate.org.uk/robots.txt
Domain IPs 104.21.39.95, 172.67.144.8, 2606:4700:3035::ac43:9008, 2606:4700:3037::6815:275f
Response IP 172.67.144.8
Found Yes
Hash 5c6a46966e8fb0d0f3841785e855f57b55eb61be5f0d2c03a7edcede81e2b70e
SimHash 29443244c1b1

Groups

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

*

Rule Path
Disallow /oc-admin/
Disallow /display/
Disallow /adpointer/
Disallow *q%3D%2C*
Disallow *contact?v=*
Disallow *sShowAs*
Disallow *sOrder%2Ci_price*
Disallow *iPage*
Disallow *item/mark*
Disallow *item/send-friend*
Disallow *item-prev*
Disallow *item-next*
Disallow *page%3Dajax*
Disallow *install.css*
Disallow *ShowSearchMeta%2CShow*
Disallow *lngp*
Disallow *languages*
Disallow *maoin.ie*maoin.ie*
Disallow *ie/maoin.ie*
Disallow *realtyww.info*maoin.ie*
Disallow *category%2C*category%2C*
Disallow *country%2C*country%2C*
Disallow *city%2C*city%2C*
Disallow *category%2Cuk%2B*
Disallow *category%2Cd%2Bsearch%2B*
Disallow *category%2C*thumbnail.jpg*
Disallow *category%2C*-r*
Disallow *category%2C*-c*
Disallow *category%2C*_i*
Disallow *category%2C*_lid*

bingbot

Rule Path
Disallow *sFeed%2Crss*
Disallow *map-img*

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://real-estate.org.uk/map-cit
sitemap https://real-estate.org.uk/map-img
sitemap https://real-estate.org.uk/map-latest