Log In Sign Up

senikersku.com
robots.txt

Robots Exclusion Standard data for senikersku.com

Resource Scan

Scan Details

Site Domain senikersku.com
Base Domain senikersku.com
Scan Status Ok
Last Scan2024-06-03T23:21:43+00:00
Next Scan 2024-07-03T23:21:43+00:00

Last Scan

Scanned2024-06-03T23:21:43+00:00
URL https://senikersku.com/robots.txt
Domain IPs 104.21.19.126, 172.67.186.44, 2606:4700:3033::ac43:ba2c, 2606:4700:3035::6815:137e
Response IP 104.21.19.126
Found Yes
Hash f0c2ebc856297fc9f50bde2bb4d8e2c1a8d9e7a2de17a3b61dfe891fe4922209
SimHash 1a56f140fc28

Groups

*

Rule Path
Disallow /api/
Disallow /search?

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

attentio

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cloudfind

Rule Path
Disallow /

cloudfind/1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

botify

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

siteimprovebot

Rule Path
Disallow /

siteimprovebot-crawler

Rule Path
Disallow /

cxense

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

marketgoo

Rule Path
Disallow /

prerender

Rule Path
Disallow /

addthis

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /
Back to top

Comments

  • *
  • ChatGPT-User
  • GPTBot
  • Google-Extended
  • AhrefsBot
  • Attentio
  • Barkrowler
  • BLEXBot
  • Cloudfind
  • Cloudfind/1.0
  • dotbot
  • ltx71
  • MegaIndex
  • MegaIndex.ru
  • MauiBot
  • MJ12bot
  • SemrushBot
  • botify
  • DataForSeoBot
  • SiteAuditBot
  • SiteimproveBot
  • SiteimproveBot-Crawler
  • Cxense
  • rogerbot
  • MarketGoo
  • prerender
  • AddThis
  • SeekportBot
  • AwarioRssBot
  • AwarioSmartBot
  • SemrushBot-BA
  • SemrushBot-SI
  • SemrushBot-SWA
  • SemrushBot-CT
  • SemrushBot-SI
  • SplitSignalBot
  • SemrushBot-COUB
  • ClaudeBot
  • coccocbot-image
Back to top