ekonobil.com
robots.txt

Robots Exclusion Standard data for ekonobil.com

Resource Scan

Scan Details

Site Domain ekonobil.com
Base Domain ekonobil.com
Scan Status Ok
Last Scan2024-11-16T00:23:23+00:00
Next Scan 2024-11-23T00:23:23+00:00

Last Scan

Scanned2024-11-16T00:23:23+00:00
URL http://ekonobil.com/robots.txt
Domain IPs 185.103.197.57
Response IP 185.103.197.57
Found Yes
Hash 8affaa9fe404baec1dcba9379da9c834645af24abeace43702ce35d8bb71f79e
SimHash 2bf442c2f09b

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /gazeteler*
Allow /canli-borsa*
Allow /canli-forex
Allow /doviz-kuru
Allow /faiz
Allow /altin-fiyatlari
Allow /imsakiye
Allow /sans-oyunu-sonuclari*
Disallow /*?doing_wp_cron
Disallow /*?autorefresh=*
Disallow *?replytocom
Disallow /*%26replytocom%3D*
Disallow *?_selected*
Disallow /wp-content/themes/
Disallow /wp-content/plugins/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /hava-durumu
Disallow /wp-update-server/
Disallow /update-plugins-json/
Disallow /wp-
Disallow /?s=
Disallow /search
Disallow /deneme
Disallow /botson*
Disallow /autobotik*
Disallow /adcentric
Disallow /adinterax
Disallow /atlas
Disallow /doubleclick
Disallow /eyereturn
Disallow /eyewonder
Disallow /klipmart
Disallow /pointroll
Disallow /smartadserver
Disallow /unicast
Disallow /viewpoint
Disallow /addineyeV2.html
Disallow /canvas.html
Disallow /DARTIframe.html
Disallow /interim.html
Disallow /oggiPlayerLoader.htm
Disallow /videoeggbackup.html
Disallow /search/
Disallow /ie/

googlebot

Rule Path
Allow /

google adsense

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexbot

Rule Path
Allow /

ask

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

xenu’s link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baidu

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ranklite

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

fhscan

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexmedia

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexnews

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexpagechecker

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

odklbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

Other Records

Field Value
sitemap http://www.ekonobil.com/sitemap.xml.gz
sitemap http://www.ekonobil.com/sitemap.xml
sitemap http://www.ekonobil.com/sitemap-borsa.xml.gz
sitemap http://www.ekonobil.com/sitemap-borsa.xml

Comments

  • Blocking bad link checker robots
  • User-agent: Google
  • Crawl-delay: 5

Warnings

  • `host` is not a known field.