gidshtor.ru
robots.txt

Robots Exclusion Standard data for gidshtor.ru

Resource Scan

Scan Details

Site Domain gidshtor.ru
Base Domain gidshtor.ru
Scan Status Ok
Last Scan2024-10-25T17:29:52+00:00
Next Scan 2024-11-01T17:29:52+00:00

Last Scan

Scanned2024-10-25T17:29:52+00:00
URL https://gidshtor.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:3:0:180, 37.140.192.25
Response IP 37.140.192.25
Found Yes
Hash 3482b0a46111fd153f6ab904b95e256ca1b074b5677e0591fe493bd78d81f04b
SimHash 4b5cd265a636

Groups

yandex

Rule Path
Disallow *?replytocom=
Disallow /bez-rubriki
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow */trackback
Disallow */feed/
Disallow */feed
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow /wp-json/*
Disallow */category/*
Disallow */comment
Disallow */tag/*
Disallow *attachment*
Disallow *?print=*
Disallow */print/
Disallow *show%3Dslide*
Disallow /author/*
Disallow /?site=colorzone
Disallow /gallery
Disallow /photos
Disallow /2014/
Disallow /2015/

googlebot

Rule Path
Disallow *?replytocom=
Disallow /bez-rubriki
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow */trackback
Disallow */feed/
Disallow */feed
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow /wp-json/*
Disallow */category/*
Disallow */comment
Disallow */tag/*
Disallow *attachment*
Disallow *?print=*
Disallow */print/
Disallow *show%3Dslide*
Disallow /author/*
Disallow /?site=colorzone
Disallow /gallery
Disallow /photos
Disallow /2014/
Disallow /2015/

*

Rule Path
Disallow *?replytocom=
Disallow /bez-rubriki
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow */trackback
Disallow */feed/
Disallow */feed
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow /wp-json/*
Disallow */category/*
Disallow */comment
Disallow */tag/*
Disallow *attachment*
Disallow *?print=*
Disallow */print/
Disallow *show%3Dslide*
Disallow /author/*
Disallow /?site=colorzone
Disallow /gallery
Disallow /photos
Disallow /2014/
Disallow /2015/

mail.ru

Rule Path
Disallow *?replytocom=
Disallow /bez-rubriki
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /search
Disallow */trackback
Disallow */feed/
Disallow */feed
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow /wp-json/*
Disallow */category/*
Disallow */comment
Disallow */tag/*
Disallow *attachment*
Disallow *?print=*
Disallow */print/
Disallow *show%3Dslide*
Disallow /author/*
Disallow /gallery
Disallow /photos
Disallow /2014/
Disallow /2015/
Disallow /?site=colorzone
Allow /wp-content/uploads/

yandex

Rule Path
Disallow *.jpg
Disallow *.gif
Disallow *.png

googlebot

Rule Path
Disallow *.jpg
Disallow *.gif
Disallow *.png

yandeximages

Rule Path
Disallow /

yandex/1.01.001 (compatible; win16; p)

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap http://gidshtor.ru/sitemap.xml

Warnings

  • `host` is not a known field.