indekskitap.com
robots.txt

Robots Exclusion Standard data for indekskitap.com

Resource Scan

Scan Details

Site Domain indekskitap.com
Base Domain indekskitap.com
Scan Status Ok
Last Scan2024-09-08T23:07:53+00:00
Next Scan 2024-10-08T23:07:53+00:00

Last Scan

Scanned2024-09-08T23:07:53+00:00
URL https://indekskitap.com/robots.txt
Domain IPs 104.19.156.83, 104.19.157.83
Response IP 104.19.157.83
Found Yes
Hash 7cd5316834643f1f17bb9f4d0e54a234db980ac9c62097cbb30ab1a4b1a32107
SimHash 444458b255f3

Groups

mj12bot

Rule Path
Disallow /

baiduspiders

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /uye-girisi
Disallow /uye-girisi?next=order2
Disallow /uye-ol
Disallow /uye-ol?next=order2
Disallow /sifremi-unuttum
Disallow /sepet
Disallow /hesabim
Disallow /hesabim/*
Disallow /dosya/
Disallow /admin/
Disallow /brand/listByCategory/categoryId/
Disallow /brand/listByCategory/categoryId/*
Disallow /cart/
Disallow /cart/*
Disallow /*index.php?do=catalog%2Fprint&

Other Records

Field Value
crawl-delay 20

*

Rule Path
Allow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.indekskitap.com/sitemap.xml

Comments

  • IdeaSoft Akilli E-ticaret | robots.txt

Warnings

  • 2 invalid lines.