istikbal.com.tr
robots.txt

Robots Exclusion Standard data for istikbal.com.tr

Resource Scan

Scan Details

Site Domain istikbal.com.tr
Base Domain istikbal.com.tr
Scan Status Ok
Last Scan2024-09-29T23:57:44+00:00
Next Scan 2024-10-29T23:57:44+00:00

Last Scan

Scanned2024-09-29T23:57:44+00:00
URL https://istikbal.com.tr/robots.txt
Domain IPs 104.16.0.42, 104.16.31.41
Response IP 104.16.31.41
Found Yes
Hash bd8dbed1b9cbca7dfa3a8f2b8ace38885390b37d8324353ca350977f672a6d85
SimHash d55c3e92d493

Groups

mj12bot

Rule Path
Disallow /

baiduspiders

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /uye-girisi
Disallow /uye-girisi?next=order2
Disallow /uye-ol
Disallow /uye-ol?next=order2
Disallow /sifremi-unuttum
Disallow /sepet
Disallow /hesabim
Disallow /hesabim/*
Disallow /dosya/
Disallow /admin/
Disallow /brand/listByCategory/categoryId/
Disallow /brand/listByCategory/categoryId/*
Disallow /cart/
Disallow /cart/*
Disallow /*index.php?do=catalog%2Fprint&
Disallow /*?varyantlar=*
Disallow /*?category=*
Disallow /*?siralama=*
Disallow /*?filtre_secenekleri=*
Disallow /*?stoktakiler=*
Disallow /*?ozellikler=*
Disallow /arama/
Disallow /search/
Disallow /en/*
Disallow /fr/*
Disallow /product/
Disallow /category/
Disallow /*?marka=*
Disallow /en*
Disallow /fr*
Disallow /dosya/kumas.html

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.istikbal.com.tr/sitemap.xml

Comments

  • IdeaSoft Akilli E-ticaret | robots.txt

Warnings

  • 2 invalid lines.