whitestrip.ru
robots.txt

Robots Exclusion Standard data for whitestrip.ru

Resource Scan

Scan Details

Site Domain whitestrip.ru
Base Domain whitestrip.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-05T19:05:47+00:00
Next Scan 2024-12-04T19:05:47+00:00

Last Successful Scan

Scanned2024-02-09T18:13:26+00:00
URL https://whitestrip.ru/robots.txt
Domain IPs 87.236.16.74
Response IP 87.236.16.74
Found Yes
Hash 9a399a96aa8f04fec76818246762b157b1ae53abe69a314ccfa1e6c4f4c1bdc5
SimHash a971d1464354

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /xmlrpc.php
Disallow /search*
Disallow /author/*
Disallow /user/
Disallow /template.html
Disallow /readme.html
Disallow */page/
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow */page/*
Disallow *?*
Disallow *?s=
Allow *.js
Allow *.css

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://whitestrip.ru/sitemap.xml