gent-dev.com
robots.txt
Robots Exclusion Standard data for gent-dev.com
Resource Scan
Scan Details
| Site Domain | gent-dev.com |
| Base Domain | gent-dev.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T07:40:31+00:00 |
| Next Scan | 2024-11-19T07:40:31+00:00 |
Last Scan
| Scanned | 2024-11-12T07:40:31+00:00 |
| URL | https://gent-dev.com/robots.txt |
| Domain IPs | 212.224.118.137 |
| Response IP | 212.224.118.137 |
| Found | Yes |
| Hash | b26b5fa44258689be54e0579742979078993c253e6fc3fa2d95d7390e59224dc |
| SimHash | 05a0a0330c30 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | клаÑÑика... |
| Disallow | /? | вÑе паÑамеÑÑÑ Ð·Ð°Ð¿ÑоÑа на главной |
| Disallow | /wp- | вÑе ÑÐ°Ð¹Ð»Ñ WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | *?s= | поиÑк |
| Disallow | *%26s%3D | поиÑк |
| Disallow | /search | поиÑк |
| Disallow | /author/ | аÑÑ |
| Disallow | *?attachment_id= | ÑÑÑаниÑа вложениÑ. ÐообÑе-Ñо на ней ÑедиÑекÑ... |
| Disallow | */feed | вÑе ÑÐ¸Ð´Ñ |
| Disallow | */rss | rss Ñид |
| Disallow | */embed | вÑе вÑÑÑÐ°Ð¸Ð²Ð°Ð½Ð¸Ñ |
| Disallow | */page/ | вÑе Ð²Ð¸Ð´Ñ Ð¿Ð°Ð³Ð¸Ð½Ð°Ñии |
| Allow | */uploads | оÑкÑÑваем uploads |
| Allow | /*/*.js | внÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
| Allow | /*/*.css | внÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
| Allow | /wp-*.png | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /wp-*.jpg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /wp-*.jpeg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /wp-*.gif | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
Other Records
| Field | Value | Comment |
|---|---|---|
| sitemap | https://gent-dev.com/sitemap.xml | - |
| sitemap | https://gent-dev.com/sitemap2.xml | еÑе один Ñайл |
Warnings
- 5 invalid lines.
- `host` is not a known field.
Comments