oncology.ru
robots.txt
Robots Exclusion Standard data for oncology.ru
Resource Scan
Scan Details
| Site Domain | oncology.ru |
| Base Domain | oncology.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-22T05:08:30+00:00 |
| Next Scan | 2024-11-21T05:08:30+00:00 |
Last Scan
| Scanned | 2024-10-22T05:08:30+00:00 |
| URL | https://oncology.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:7:3d74, 2a00:15f8:a000:5:1:12:7:3d74, 2a00:15f8:a000:5:1:13:7:3d74, 2a00:15f8:a000:5:1:14:7:3d74, 90.156.201.105, 90.156.201.117, 90.156.201.66, 90.156.201.86 |
| Response IP | 90.156.201.117 |
| Found | Yes |
| Hash | 11fe28dfe8a5237882f8cf9779fbaafcc0bddb55912440198863236b77542c5f |
| SimHash | 61389923dff9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /test |
| Disallow | /test/ |
| Disallow | /tmp |
| Disallow | /tmp/ |
| Disallow | /cgi-bin/ |
| Disallow | /_* |
| Disallow | /_*/ |
| Disallow | /adv/ |
| Disallow | /captcha/ |
| Disallow | /css/ |
| Disallow | /download/ |
| Disallow | /epoll/ |
| Disallow | /gallery/ |
| Disallow | /i/ |
| Disallow | /inc/ |
| Disallow | /inquirer/ |
| Disallow | /js/ |
| Disallow | /promo/ |
| Disallow | /QR_cod/ |
| Disallow | /registration/ |
| Disallow | /response/ |
| Disallow | /Scripts/ |
| Disallow | /stat/ |
| Disallow | /terms-of-use.pdf |
| Disallow | /upload/ |
| Disallow | /newsletter/ |
| Disallow | /_*.* |
| Disallow | *.txt |
| Disallow | *.db |
| Disallow | *.doc |
| Disallow | *.docx |
| Disallow | *.xls |
| Disallow | *.xlsx |
| Disallow | *.htaccess |
| Disallow | *.htpasswd |
| Disallow | *.ppk |
| Disallow | /encode.pl |
| Disallow | /search.pl |
| Disallow | /chmod.php |
| Disallow | /info.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://oncology.ru/sitemap.xml |
| sitemap | http://oncology.ru/sitemap.xml |
Warnings
- `host` is not a known field.
Comments