snovidenija.ru
robots.txt

Robots Exclusion Standard data for snovidenija.ru

Resource Scan

Scan Details

Site Domain snovidenija.ru
Base Domain snovidenija.ru
Scan Status Ok
Last Scan2024-09-12T17:48:15+00:00
Next Scan 2024-10-12T17:48:15+00:00

Last Scan

Scanned2024-09-12T17:48:15+00:00
URL https://snovidenija.ru/robots.txt
Domain IPs 104.21.19.56, 172.67.185.68, 2606:4700:3031::6815:1338, 2606:4700:3032::ac43:b944
Response IP 104.21.19.56
Found Yes
Hash 01fcdb1f8a62eb8f2f0ae40d2e7add8210cd0e96d1792f8dc3b026d1cdd3e5d8
SimHash 7b5d4e421e99

Groups

*

Rule Path
Disallow /users/
Disallow /*page
Disallow /*top
Disallow /*discussed

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

begun

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

Warnings

  • `host` is not a known field.