mostech-group.ru
robots.txt

Robots Exclusion Standard data for mostech-group.ru

Resource Scan

Scan Details

Site Domain mostech-group.ru
Base Domain mostech-group.ru
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-24T13:54:11+00:00
Next Scan 2024-11-22T13:54:11+00:00

Last Successful Scan

Scanned2024-01-28T13:30:23+00:00
URL https://mostech-group.ru/robots.txt
Domain IPs 31.135.13.159
Response IP 31.135.13.159
Found Yes
Hash 332d356c353960bd1c95b65118eae403ebe9099daaf7834c4b78833627cae458
SimHash 4b5887022612

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /*?
Disallow /?s=
Allow /*.css
Allow /*.js

Other Records

Field Value
sitemap https://mostech-group.ru/sitemap_index.xml

Warnings

  • `host` is not a known field.