Log In Sign Up

smartoptions.trendlyne.com
robots.txt

Robots Exclusion Standard data for smartoptions.trendlyne.com

Resource Scan

Scan Details

Site Domain smartoptions.trendlyne.com
Base Domain trendlyne.com
Scan Status Ok
Last Scan2025-12-12T22:09:39+00:00
Next Scan 2026-01-11T22:09:39+00:00

Last Scan

Scanned2025-12-12T22:09:39+00:00
URL https://smartoptions.trendlyne.com/robots.txt
Domain IPs 2600:9000:2894:2600:19:5c6:340:93a1, 2600:9000:2894:4200:19:5c6:340:93a1, 2600:9000:2894:6600:19:5c6:340:93a1, 2600:9000:2894:8e00:19:5c6:340:93a1, 2600:9000:2894:ac00:19:5c6:340:93a1, 2600:9000:2894:bc00:19:5c6:340:93a1, 2600:9000:2894:d200:19:5c6:340:93a1, 2600:9000:2894:dc00:19:5c6:340:93a1, 3.170.229.107, 3.170.229.121, 3.170.229.61, 3.170.229.96
Response IP 3.170.229.121
Found Yes
Hash 842c68daf44adae056cfb4418f9b2b5eee91f79ccfcd4361899c0264ab658654
SimHash 521ed058c07c

Groups

ahrefsbot
jobboersebot
petalbot
aspiegelbot
bytedancespider
bytespider
blexbot
dataforseobot
yandexbot
yandex
baiduspider
sogou web spider
sogou spider
mj12bot
uptimerobot
gnowitnewsbot
awariorssbot
awariobot
awariosmartbot
trendictionbot
proximic
sbintuitionsbot
zoombot
slackbot-linkexpanding
slack-imgproxy
slackbot
turnitinbot
imagesiftbot
terracotta

Rule Path
Disallow /

*

Rule Path
Disallow */my-alerts/*
Disallow */strategy-builder/user/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://smartoptions.trendlyne.com/home-sitemap.xml
Back to top

Comments

  • Every bot that might possibly read and respect this file
  • ========================================================
  • Blocked paths for other bots
  • ==========================
  • Wait 1 second between successive requests. See ONBOARD-2698 for details.
Back to top