www.office.peterlife.ru
robots.txt

Robots Exclusion Standard data for www.office.peterlife.ru

Resource Scan

Scan Details

Site Domain www.office.peterlife.ru
Base Domain peterlife.ru
Scan Status Ok
Last Scan2025-09-13T09:46:25+00:00
Next Scan 2025-10-13T09:46:25+00:00

Last Scan

Scanned2025-09-13T09:46:25+00:00
URL http://www.office.peterlife.ru/robots.txt
Domain IPs 217.112.43.74
Response IP 217.112.43.74
Found Yes
Hash a7f1097dd5ca590da19b46ed281b81cb335dc75663b054c90fd95072a5cfcdb6
SimHash 6e44ccd385b1

Groups

yandex

Rule Path
Allow /
Disallow /bitrix/
Disallow /wp-includes/
Disallow /wp-content/

googlebot

Rule Path
Allow /
Disallow /bitrix/
Disallow /wp-includes/
Disallow /wp-content/

*

Rule Path
Disallow /
Disallow /wp-includes/
Disallow /wp-content/
Allow /*.html
Allow /*/*.html
Allow /*/*/*.html

Other Records

Field Value
crawl-delay 30.0

Other Records

Field Value
sitemap http://www.office.peterlife.ru/sitemap.txt
sitemap http://www.office.peterlife.ru/sitemap.xml
sitemap http://www.office.peterlife.ru/auction/sitemap.xml
sitemap http://www.office.peterlife.ru/kanctovar/sitemap.xml
sitemap http://www.office.peterlife.ru/officeamazon/sitemap.xml
sitemap http://www.office.peterlife.ru/officebrend/sitemap.xml

Warnings

  • `host` is not a known field.