Log In Sign Up

sutindo.com
robots.txt

Robots Exclusion Standard data for sutindo.com

Resource Scan

Scan Details

Site Domain sutindo.com
Base Domain sutindo.com
Scan Status Ok
Last Scan3/6/2025, 7:51:42 PM
Next Scan 4/5/2025, 7:51:42 PM

Last Scan

Scanned3/6/2025, 7:51:42 PM
URL https://sutindo.com/robots.txt
Domain IPs 111.221.44.122
Response IP 111.221.44.122
Found Yes
Hash d5724a0f2fcf87d17a85289d004a696a9f72e080a262968f85cd01b08ae68a24
SimHash 1e16f140fd28

Groups

*

Rule Path
Disallow /api/
Disallow /search?

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

attentio

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cloudfind

Rule Path
Disallow /

cloudfind/1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

botify

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

siteimprovebot

Rule Path
Disallow /

siteimprovebot-crawler

Rule Path
Disallow /

cxense

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

marketgoo

Rule Path
Disallow /

prerender

Rule Path
Disallow /

addthis

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /
Back to top

Comments

  • *
  • ChatGPT-User
  • GPTBot
  • Google-Extended
  • AhrefsBot
  • Attentio
  • Barkrowler
  • BLEXBot
  • Cloudfind
  • Cloudfind/1.0
  • dotbot
  • ltx71
  • MegaIndex
  • MegaIndex.ru
  • MauiBot
  • MJ12bot
  • SemrushBot
  • botify
  • DataForSeoBot
  • SiteAuditBot
  • SiteimproveBot
  • SiteimproveBot-Crawler
  • Cxense
  • rogerbot
  • MarketGoo
  • prerender
  • AddThis
  • SeekportBot
  • AwarioRssBot
  • AwarioSmartBot
  • SemrushBot-BA
  • SemrushBot-SI
  • SemrushBot-SWA
  • SemrushBot-CT
  • SemrushBot-SI
  • SplitSignalBot
  • SemrushBot-COUB
Back to top