emlakjet.com
robots.txt

Robots Exclusion Standard data for emlakjet.com

Resource Scan

Scan Details

Site Domain emlakjet.com
Base Domain emlakjet.com
Scan Status Ok
Last Scan2024-05-22T04:35:28+00:00
Next Scan 2024-05-29T04:35:28+00:00

Last Scan

Scanned2024-05-22T04:35:28+00:00
URL https://emlakjet.com/robots.txt
Redirect https://www.emlakjet.com/robots.txt
Redirect Domain www.emlakjet.com
Redirect Base emlakjet.com
Domain IPs 212.103.38.205
Redirect IPs 104.22.24.248, 104.22.25.248, 172.67.28.120
Response IP 104.22.24.248
Found Yes
Hash 30e4f61a7960c8afe669a5daa99ff72ba40a3aac7df03ea6ca2d00cc79c01055
SimHash 2d46505102f1

Groups

*

Rule Path
Allow /
Disallow /listings/*
Disallow /a/corporate/*
Disallow /a/User/*
Disallow /get_detail/*
Disallow /haber/js/*
Disallow /listing/*.jpg
Disallow /listing/*.jpeg
Disallow /listing/*.JPG
Disallow /listing/*.png
Disallow /resize/*.jpg
Disallow /resize/*.jpeg
Disallow /resize/*.JPG
Disallow /resize/*.png
Disallow /oda/*.jpg
Disallow /oda/*.jpeg
Disallow /oda/*.JPG
Disallow /oda/*.png
Disallow /hizmetlerimiz/isbankasi-konut-kredisi/*
Disallow /hizmetlerimiz/akbank-konut-kredisi/*
Disallow /?q=.*
Disallow *q%3D*
Disallow *siralama
Disallow *max_fiyat%3D
Disallow *min_fiyat%3D
Disallow *?oda_sayisi
Disallow *?mahalle
Disallow *view_type%3Dmap*
Disallow *?pageSize=*

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

scrappy
scrappy bot
discobot
dotbot
yacybot

Rule Path
Disallow /

adsbot-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.emlakjet.com/sitemaps/index.xml

Comments

  • ______ _ _ _ _
  • | ____| | | | | (_) | |
  • | |__ _ __ ___ | | __ _| | ___ ___| |_
  • | __| | '_ ` _ \| |/ _` | |/ / |/ _ \ __|
  • | |____| | | | | | | (_| | <| | __/ |_
  • |______|_| |_| |_|_|\__,_|_|\_\ |\___|\__|
  • _/ |
  • |__/