fayaboutique.com
robots.txt

Robots Exclusion Standard data for fayaboutique.com

Resource Scan

Scan Details

Site Domain fayaboutique.com
Base Domain fayaboutique.com
Scan Status Ok
Last Scan2024-09-25T19:16:04+00:00
Next Scan 2024-10-25T19:16:04+00:00

Last Scan

Scanned2024-09-25T19:16:04+00:00
URL https://fayaboutique.com/robots.txt
Domain IPs 104.19.156.83, 104.19.157.83
Response IP 104.19.157.83
Found Yes
Hash d9a838e2a9c4ad53a5bce6b776a49e443c5d233546fd3530e66eebcbd17f6333
SimHash 51445cb257f2

Groups

mj12bot

Rule Path
Disallow /

baiduspiders

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /uye-girisi
Disallow /uye-girisi?next=order2
Disallow /uye-ol
Disallow /uye-ol?next=order2
Disallow /sifremi-unuttum
Disallow /sepet
Disallow /hesabim
Disallow /hesabim/*
Disallow /dosya/
Disallow /admin/
Disallow /brand/listByCategory/categoryId/
Disallow /brand/listByCategory/categoryId/*
Disallow /cart/
Disallow /cart/*
Disallow /*index.php?do=catalog%2Fprint&

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.fayaboutique.com/sitemap.xml

Comments

  • IdeaSoft Akilli E-ticaret | robots.txt

Warnings

  • 2 invalid lines.