gipermarket-site.ru
robots.txt

Robots Exclusion Standard data for gipermarket-site.ru

Resource Scan

Scan Details

Site Domain gipermarket-site.ru
Base Domain gipermarket-site.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-16T02:37:53+00:00
Next Scan 2025-01-14T02:37:53+00:00

Last Successful Scan

Scanned2024-03-21T02:32:55+00:00
URL https://gipermarket-site.ru/robots.txt
Domain IPs 104.21.28.32, 172.67.170.57, 2606:4700:3034::ac43:aa39, 2606:4700:3037::6815:1c20
Response IP 172.67.170.57
Found Yes
Hash 52fc8c42834f9d69f79cab357b14e39da3c0f074a20b03a8b29cc7e641844ce7
SimHash ad714b454314

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /xmlrpc.php
Disallow /search*
Disallow /author/*
Disallow /user/
Disallow /template.html
Disallow /readme.html
Disallow */page/
Disallow */trackback/
Disallow */tag/*
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */page/*
Disallow */alphabet/*
Disallow */time/*
Disallow */age/*
Disallow *?*
Disallow *?s=
Allow *.js
Allow *.css

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://gipermarket-site.ru/sitemap.xml