mainspb.ru
robots.txt
Robots Exclusion Standard data for mainspb.ru
Resource Scan
Scan Details
| Site Domain | mainspb.ru |
| Base Domain | mainspb.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 3/3/2025, 11:57:34 PM |
| Next Scan | 6/1/2025, 11:57:34 PM |
Last Successful Scan
| Scanned | 7/20/2023, 11:28:51 PM |
| URL | https://mainspb.ru/robots.txt |
| Redirect | http://mainspb.ru/robots.txt |
| Domain IPs | 104.21.37.202, 172.67.212.228, 2606:4700:3033::ac43:d4e4, 2606:4700:3035::6815:25ca |
| Response IP | 104.21.37.202 |
| Found | Yes |
| Hash | e08fec12657da47ec46ec2bb6b4738e23d8a09355272a64dc9027d39fd73b313 |
| SimHash | 7811db648313 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search |
| Disallow | /play |