modalife.com
robots.txt

Robots Exclusion Standard data for modalife.com

Resource Scan

Scan Details

Site Domain modalife.com
Base Domain modalife.com
Scan Status Ok
Last Scan2024-09-10T17:28:18+00:00
Next Scan 2024-10-10T17:28:18+00:00

Last Scan

Scanned2024-09-10T17:28:18+00:00
URL https://modalife.com/robots.txt
Domain IPs 104.19.156.83, 104.19.157.83
Response IP 104.19.156.83
Found Yes
Hash 25ca4726d4bb5e9f7166649d8fcaa35f4f49992910dec091d7c3df8be14c670f
SimHash d1445cb258b3

Groups

mj12bot

Rule Path
Disallow /

baiduspiders

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /uye-girisi
Disallow /uye-girisi?next=order2
Disallow /uye-ol
Disallow /uye-ol?next=order2
Disallow /sifremi-unuttum
Disallow /sepet
Disallow /hesabim
Disallow /hesabim/*
Disallow /dosya/
Disallow /admin/
Disallow /brand/listByCategory/categoryId/
Disallow /brand/listByCategory/categoryId/*
Disallow /cart/
Disallow /cart/*
Disallow /*index.php?do=catalog%2Fprint&

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.modalife.com/sitemap.xml

Comments

  • IdeaSoft Akilli E-ticaret | robots.txt

Warnings

  • 2 invalid lines.