Log In Sign Up

servise-spb.ru
robots.txt

Robots Exclusion Standard data for servise-spb.ru

Resource Scan

Scan Details

Site Domain servise-spb.ru
Base Domain servise-spb.ru
Scan Status Ok
Last Scan2024-09-22T02:35:51+00:00
Next Scan 2024-10-22T02:35:51+00:00

Last Scan

Scanned2024-09-22T02:35:51+00:00
URL https://servise-spb.ru/robots.txt
Domain IPs 104.21.40.162, 172.67.187.109, 2606:4700:3035::6815:28a2, 2606:4700:3035::ac43:bb6d
Response IP 172.67.187.109
Found Yes
Hash 4c874231309e6a4f51d1aad6f5ef05737de0d7ad36742159ae63c8cdb08d7d9c
SimHash 527641606610

Groups

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

linux

Rule Path
Disallow /

openstat.ru/bot

Rule Path
Disallow /

openstat.ru

Rule Path
Disallow /

webcopy

Rule Path
Disallow /

checker

Rule Path
Disallow /

crawl

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

thumbsniper

Rule Path
Disallow /

validator.nu

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

*

Rule Path
Disallow
Back to top

Warnings

  • 2 invalid lines.
Back to top