rescom.ru
robots.txt
Robots Exclusion Standard data for rescom.ru
Resource Scan
Scan Details
Site Domain | rescom.ru |
Base Domain | rescom.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-16T03:43:14+00:00 |
Next Scan | 2024-09-30T03:43:14+00:00 |
Last Successful Scan
Scanned | 2024-08-09T03:08:02+00:00 |
URL | https://rescom.ru/robots.txt |
Domain IPs | 2a00:f940:2:2:1:2:0:8, 5.63.156.206 |
Response IP | 5.63.156.206 |
Found | Yes |
Hash | 68c6799a11b049e8ac8ed0cf8ec545a8f51e3a45bfb0461b3b900bb2f189b6f2 |
SimHash | 46566bf05d99 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-*/*.css |
Allow | /wp-*/*.js |
Allow | /wp-*/*.jpg |
Allow | /wp-*/*.png |
Allow | /wp-*/*.gif |
Disallow | /author/ |
Disallow | /wp- |
Disallow | /readme |
Disallow | /comments |
Disallow | /search |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | */reviews/ |
Disallow | */attachment/ |
Disallow | */embed |
Disallow | */page/ |
Disallow | *ycl%3D |
Disallow | *gcl%3D |
Disallow | *cpa%3D |
Disallow | *utm%3D |
Disallow | *clid%3D |
Disallow | *openstat%3D |
yandex
Rule | Path |
---|---|
Allow | /wp-*/*.css |
Allow | /wp-*/*.js |
Allow | /wp-*/*.jpg |
Allow | /wp-*/*.png |
Allow | /wp-*/*.gif |
Disallow | /author/ |
Disallow | /wp- |
Disallow | /readme |
Disallow | /comments |
Disallow | /search |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | */reviews/ |
Disallow | */attachment/ |
Disallow | */embed |
Disallow | */page/ |
Disallow | *ycl%3D |
Disallow | *gcl%3D |
Disallow | *cpa%3D |
Disallow | *utm%3D |
Disallow | *clid%3D |
Disallow | *openstat%3D |
mail.ru
Rule | Path |
---|---|
Disallow | /author/ |
Disallow | /wp- |
Disallow | /readme |
Disallow | /comments |
Disallow | /search |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | */reviews/ |
Disallow | */attachment/ |
Disallow | */embed |
Disallow | */page/ |
Disallow | *ycl%3D |
Disallow | *gcl%3D |
Disallow | *cpa%3D |
Disallow | *utm%3D |
Disallow | *clid%3D |
Disallow | *openstat%3D |
Other Records
Field | Value |
---|---|
crawl-delay | 600 |
Other Records
Field | Value |
---|---|
sitemap | https://rescom.ru/sitemap.xml |
Warnings
- 2 invalid lines.
- `clean-param` is not a known field.
Comments