si21.com
robots.txt
Robots Exclusion Standard data for si21.com
Resource Scan
Scan Details
| Site Domain | si21.com |
| Base Domain | si21.com |
| Scan Status | Ok |
| Last Scan | 2024-09-29T03:35:10+00:00 |
| Next Scan | 2024-10-06T03:35:10+00:00 |
Last Scan
| Scanned | 2024-09-29T03:35:10+00:00 |
| URL | https://si21.com/robots.txt |
| Redirect | https://www.si21.com/robots.txt |
| Redirect Domain | www.si21.com |
| Redirect Base | si21.com |
| Domain IPs | 185.97.52.146 |
| Redirect IPs | 185.97.52.146 |
| Response IP | 185.97.52.146 |
| Found | Yes |
| Hash | b41bfaac90af4f59a0534409f4255701a5a5e62b2233167035a83e627230e6d4 |
| SimHash | 9afc5d4a5fa0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /petya/ |
| Disallow | /nep/ |
| Disallow | /avto/ |
| Disallow | /news_archive.php |
| Disallow | /news.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
Comments