starfolio.trendlyne.com
robots.txt

Robots Exclusion Standard data for starfolio.trendlyne.com

Resource Scan

Scan Details

Site Domain starfolio.trendlyne.com
Base Domain trendlyne.com
Scan Status Ok
Last Scan2026-02-05T00:18:58+00:00
Next Scan 2026-03-07T00:18:58+00:00

Last Scan

Scanned2026-02-05T00:18:58+00:00
URL https://starfolio.trendlyne.com/robots.txt
Domain IPs 13.35.202.126, 13.35.202.62, 13.35.202.67, 13.35.202.96, 2600:9000:2078:2600:2:1882:59c0:93a1, 2600:9000:2078:2800:2:1882:59c0:93a1, 2600:9000:2078:4400:2:1882:59c0:93a1, 2600:9000:2078:4e00:2:1882:59c0:93a1, 2600:9000:2078:7600:2:1882:59c0:93a1, 2600:9000:2078:8200:2:1882:59c0:93a1, 2600:9000:2078:c00:2:1882:59c0:93a1, 2600:9000:2078:c800:2:1882:59c0:93a1
Response IP 13.35.202.62
Found Yes
Hash c12d986913b90932b21404545e8934b9ec40ab666901527d756aba4855cdd581
SimHash 721ed050c07c

Groups

ahrefsbot
jobboersebot
petalbot
aspiegelbot
bytedancespider
bytespider
blexbot
dataforseobot
yandexbot
yandex
baiduspider
sogou web spider
sogou spider
mj12bot
uptimerobot
gnowitnewsbot
awariorssbot
awariobot
awariosmartbot
trendictionbot
proximic
sbintuitionsbot
zoombot
slackbot-linkexpanding
slack-imgproxy
slackbot
turnitinbot
imagesiftbot
terracotta

Rule Path
Disallow /

*

Rule Path
Disallow */create-basket/from/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://starfolio.trendlyne.com/starfolio/home-sitemap.xml

Comments

  • Every bot that might possibly read and respect this file
  • ========================================================
  • Blocked paths for other bots
  • ==========================
  • Wait 1 second between successive requests. See ONBOARD-2698 for details.