ypag.ru
robots.txt
Robots Exclusion Standard data for ypag.ru
Resource Scan
Scan Details
| Site Domain | ypag.ru |
| Base Domain | ypag.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-31T07:37:33+00:00 |
| Next Scan | 2024-11-07T07:37:33+00:00 |
Last Scan
| Scanned | 2024-10-31T07:37:33+00:00 |
| URL | http://ypag.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:6:e77c, 2a00:15f8:a000:5:1:12:6:e77c, 2a00:15f8:a000:5:1:13:6:e77c, 2a00:15f8:a000:5:1:14:6:e77c, 90.156.201.101, 90.156.201.77, 90.156.201.89, 90.156.201.93 |
| Response IP | 90.156.201.93 |
| Found | Yes |
| Hash | a617472b2f3d6c63bd6c06dfc8e932651f84ba0b082567e9dda476b652e8bfd4 |
| SimHash | 4864bcc48778 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /prosearsh.php |
| Disallow | /reg.php |
| Disallow | /err.php |
| Disallow | /err_kompany.php |
| Disallow | /regp.php |
| Disallow | /showcompd.php |
| Disallow | /userpanel.php |
| Disallow | /input.php |
| Disallow | /allbot.php |
| Disallow | /pricemsg.php |
| Disallow | /mails.php |
| Disallow | /mails_otziv.php |
| Disallow | /newpas.php |
| Disallow | /mail_massage.php |
| Disallow | /tm.php |
| Disallow | /regnew.php |
| Disallow | /img/ |
| Disallow | /select_region.php |
| Disallow | /cataloge/ |
| Disallow | /reit/ |
| Disallow | /tenders/ |
| Disallow | pricemsg_lite.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yadirectbot
| Rule | Path |
|---|---|
| Disallow | /prosearsh.php |
| Disallow | /reg.php |
| Disallow | /err.php |
| Disallow | /err_kompany.php |
| Disallow | /regp.php |
| Disallow | /showcompd.php |
| Disallow | /userpanel.php |
| Disallow | /input.php |
| Disallow | /allbot.php |
| Disallow | /pricemsg.php |
| Disallow | /mails.php |
| Disallow | /mails_otziv.php |
| Disallow | /newpas.php |
| Disallow | /mail_massage.php |
| Disallow | /tm.php |
| Disallow | /regnew.php |
| Disallow | /img/ |
| Disallow | /select_region.php |
| Disallow | /cataloge/ |
| Disallow | /reit/ |
| Disallow | /tenders/ |
| Disallow | pricemsg_lite.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `host` is not a known field.