workpaper.ru
robots.txt
Robots Exclusion Standard data for workpaper.ru
Resource Scan
Scan Details
| Site Domain | workpaper.ru |
| Base Domain | workpaper.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-05T09:23:54+00:00 |
| Next Scan | 2024-10-05T09:23:54+00:00 |
Last Scan
| Scanned | 2024-09-05T09:23:54+00:00 |
| URL | https://workpaper.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:7ddf, 2a00:15f8:a000:5:1:12:0:7ddf, 2a00:15f8:a000:5:1:13:0:7ddf, 2a00:15f8:a000:5:1:14:0:7ddf, 90.156.201.101, 90.156.201.106, 90.156.201.38, 90.156.201.89 |
| Response IP | 90.156.201.89 |
| Found | Yes |
| Hash | a8f7432bb12c66522d2c97a5acc035655d9473a450017dd5e0eb8138a6be2678 |
| SimHash | 6b09dce7e313 |
Groups
slurp
| Rule | Path |
|---|---|
| Disallow | /css |
| Disallow | /js |
| Disallow | /lib |
| Disallow | /template |
| Disallow | /pagelog |
| Disallow | /index.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
yandex
| Rule | Path |
|---|---|
| Disallow | /css |
| Disallow | /js |
| Disallow | /lib |
| Disallow | /template |
| Disallow | /pagelog |
| Disallow | /index.php |
*
| Rule | Path |
|---|---|
| Disallow | /css |
| Disallow | /js |
| Disallow | /lib |
| Disallow | /template |
| Disallow | /pagelog |
| Disallow | /index.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://workpaper.ru/sitemap.xml |
| sitemap | https://workpaper.ru/sitemap.xml |
Warnings
- `host` is not a known field.