word-to-html.ru
robots.txt

Robots Exclusion Standard data for word-to-html.ru

Resource Scan

Scan Details

Site Domain word-to-html.ru
Base Domain word-to-html.ru
Scan Status Ok
Last Scan2025-03-15T11:19:15+00:00
Next Scan 2025-04-14T11:19:15+00:00

Last Scan

Scanned2025-03-15T11:19:15+00:00
URL https://word-to-html.ru/robots.txt
Domain IPs 104.21.25.83, 172.67.133.201, 2606:4700:3035::ac43:85c9, 2606:4700:3036::6815:1953
Response IP 104.21.25.83
Found Yes
Hash 299b0026333266907ec0eccf83ee2193c598204b4e60413f2b02a5d097677dca
SimHash 4a555c739c90

Groups

ahrefsbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

bluechipbacklinks

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

konturbot

Rule Path
Disallow /

kraken

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

nutch

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

scooperbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

*

Rule Path
Disallow /user
Disallow /search
Disallow /subscription
Disallow /draft
Disallow /upload

Other Records

Field Value
sitemap https://word-to-html.ru/sitemap.xml.gz

Warnings

  • 6 invalid lines.
  • `host` is not a known field.