pes-files.com
robots.txt
Robots Exclusion Standard data for pes-files.com
Resource Scan
Scan Details
Site Domain | pes-files.com |
Base Domain | pes-files.com |
Scan Status | Ok |
Last Scan | 2024-09-17T06:07:14+00:00 |
Next Scan | 2024-09-24T06:07:14+00:00 |
Last Scan
Scanned | 2024-09-17T06:07:14+00:00 |
URL | https://pes-files.com/robots.txt |
Domain IPs | 2a03:6f00:6:1::517:3238, 5.23.50.56 |
Response IP | 5.23.50.56 |
Found | Yes |
Hash | 7ef9636419e2b5be40a2a8acf35c42bfa25e04d2d78fd3de83f92af744f7b2cc |
SimHash | 64b4b8c253b5 |
Groups
*
Product | Comment |
---|---|
* | Для всех поисковых систем, кроме Яндекса и Гугла |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | - |
Disallow | /? | - |
Disallow | /wp- | - |
Disallow | *?s= | - |
Disallow | *%26s%3D | - |
Disallow | /search/ | - |
Disallow | /author/ | - |
Disallow | /users/ | - |
Disallow | */trackback | - |
Disallow | */feed | - |
Disallow | */rss | - |
Disallow | */embed | - |
Disallow | /xmlrpc.php | - |
Disallow | *utm%3D | - |
Disallow | *openstat%3D | - |
Disallow | /tag/ | Закрываем метки |
Disallow | /readme.html | Закрываем бесполезный мануал по установке WordPress (лежит в корне) |
Disallow | *?replytocom | - |
Allow | */uploads | - |
googlebot
Product | Comment |
---|---|
googlebot | Для Гугла |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | - |
Disallow | /? | - |
Disallow | /wp- | - |
Disallow | *?s= | - |
Disallow | *%26s%3D | - |
Disallow | /search/ | - |
Disallow | /author/ | - |
Disallow | /users/ | - |
Disallow | */trackback | - |
Disallow | */feed | - |
Disallow | */rss | - |
Disallow | */embed | - |
Disallow | /xmlrpc.php | - |
Disallow | *utm%3D | - |
Disallow | *openstat%3D | - |
Disallow | /tag/ | Закрываем метки |
Disallow | /readme.html | - |
Disallow | *?replytocom | - |
Allow | */uploads | - |
Allow | /*/*.js | - |
Allow | /*/*.css | - |
Allow | /wp-*.png | - |
Allow | /wp-*.jpg | - |
Allow | /wp-*.jpeg | - |
Allow | /wp-*.gif | - |
Allow | /wp-admin/admin-ajax.php | - |
yandex
Product | Comment |
---|---|
yandex | Для Яндекса |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin | - |
Disallow | /? | - |
Disallow | /wp- | - |
Disallow | *?s= | - |
Disallow | *%26s%3D | - |
Disallow | /search/ | - |
Disallow | /author/ | - |
Disallow | /users/ | - |
Disallow | */trackback | - |
Disallow | */feed | - |
Disallow | */rss | - |
Disallow | */embed | - |
Disallow | /xmlrpc.php | - |
Disallow | /tag/ | Закрываем метки |
Disallow | /readme.html | - |
Disallow | *?replytocom | - |
Allow | */uploads | - |
Allow | /*/*.js | - |
Allow | /*/*.css | - |
Allow | /wp-*.png | - |
Allow | /wp-*.jpg | - |
Allow | /wp-*.jpeg | - |
Allow | /wp-*.gif | - |
Allow | /wp-admin/admin-ajax.php | - |
Other Records
Field | Value |
---|---|
sitemap | https://pes-files.com/sitemap.xml |
Warnings
- `host` is not a known field.