stroy-tehnolog.ru
robots.txt

Robots Exclusion Standard data for stroy-tehnolog.ru

Resource Scan

Scan Details

Site Domain stroy-tehnolog.ru
Base Domain stroy-tehnolog.ru
Scan Status Ok
Last Scan2024-09-16T07:44:24+00:00
Next Scan 2024-09-23T07:44:24+00:00

Last Scan

Scanned2024-09-16T07:44:24+00:00
URL https://stroy-tehnolog.ru/robots.txt
Domain IPs 87.236.16.26
Response IP 87.236.16.26
Found Yes
Hash 84e1fd481f43034a828864ea43801d94cafea19759493483a6f0831da8c2b5bf
SimHash 0859fed182b3

Groups

*

Rule Path
Disallow /redirect/
Disallow /author/
Disallow /wp-admin/
Disallow /wp-content/themes/
Disallow /wp-includes
Disallow /category/
Disallow /category/*/*
Disallow /page/*
Disallow /?feed=
Disallow /?s=
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */comments
Disallow */comment-page*
Disallow /*trackback
Disallow /*feed
Disallow /author*
Disallow /*?*
Disallow /*?
Disallow */%26
Disallow /%26
Disallow /?*
Disallow */feed
Disallow /feed
Disallow */trackback
Disallow /tag/*/page
Disallow /tag/
Disallow /comments/feed/
Disallow /2011/
Disallow /2012/
Disallow /2013/
Disallow /2014/
Disallow /2015/
Disallow /2016/

linkpadbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • linkpad.ru
  • majestic.com
  • ahrefs.com
  • moz.com
  • semrush.com

Warnings

  • `host` is not a known field.