prouser.me
robots.txt
Robots Exclusion Standard data for prouser.me
Resource Scan
Scan Details
| Site Domain | prouser.me |
| Base Domain | prouser.me |
| Scan Status | Ok |
| Last Scan | 2025-09-30T20:39:39+00:00 |
| Next Scan | 2025-10-30T20:39:39+00:00 |
Last Scan
| Scanned | 2025-09-30T20:39:39+00:00 |
| URL | https://prouser.me/robots.txt |
| Domain IPs | 104.21.57.122, 172.67.190.94, 2606:4700:3032::6815:397a, 2606:4700:3036::ac43:be5e |
| Response IP | 104.21.57.122 |
| Found | Yes |
| Hash | c51be3b8d436ff6da85418c279c9bd3db8d43af235e02da92691f7d97680978a |
| SimHash | 6430906c8bae |
Groups
*
| Product | Comment |
|---|---|
| * | Создаем ÑекÑÐ¸Ñ Ð¿Ñавил Ð´Ð»Ñ ÑобоÑов. * знаÑÐ¸Ñ Ð´Ð»Ñ Ð²ÑÐµÑ |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | СÑандаÑÑÐ½Ð°Ñ Ð¿Ð°Ð¿ÐºÐ° на Ñ |
| Disallow | /wp-admin/ | ÐакÑÑваем админкÑ. |
| Allow | /wp-admin/admin-ajax.php | ÐÑкÑоем аÑкÑ. |
| Disallow | /? | ÐÑе паÑамеÑÑÑ Ð·Ð°Ð¿ÑоÑа на главной. |
| Disallow | *?s= | ÐоиÑк. |
| Disallow | *%26s%3D | ÐоиÑк. |
| Disallow | /search | ÐоиÑк. |
| Disallow | /author/ | ÐÑÑ |
| Disallow | */embed$ | ÐÑе вÑÑÑаиваниÑ. |
| Disallow | */xmlrpc.php | Файл WordPress API |
| Disallow | *utm*%3D | СÑÑлки Ñ utm-меÑками |
| Disallow | *openstat%3D | СÑÑлки Ñ Ð¼ÐµÑками openstat |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 240 |
Warnings
- 2 invalid lines.
Comments