pitersuper.ru
robots.txt
Robots Exclusion Standard data for pitersuper.ru
Resource Scan
Scan Details
| Site Domain | pitersuper.ru |
| Base Domain | pitersuper.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-11T10:29:27+00:00 |
| Next Scan | 2024-08-09T10:29:27+00:00 |
Last Successful Scan
| Scanned | 2023-09-22T08:30:46+00:00 |
| URL | https://pitersuper.ru/robots.txt |
| Redirect | https://piter1.ru/robots.txt |
| Redirect Domain | piter1.ru |
| Redirect Base | piter1.ru |
| Domain IPs | 104.21.47.247, 172.67.174.214, 2606:4700:3034::6815:2ff7, 2606:4700:3035::ac43:aed6 |
| Redirect IPs | 104.21.48.90, 172.67.183.11, 2606:4700:3031::ac43:b70b, 2606:4700:3033::6815:305a |
| Response IP | 104.21.48.90 |
| Found | Yes |
| Hash | b1406b389725f6744b8142f0507263fc2d159c38417973fe5b0e9904f14511fd |
| SimHash | b5a83295e2bd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | fot*/* |
| Disallow | ph*/* |
| Disallow | /pro*/*.* |
| Disallow | all/* |
| Disallow | *all/* |
| Disallow | ad* |
| Disallow | ch* |
| Disallow | aut* |
| Disallow | ca* |
| Disallow | re* |
| Disallow | sup* |
| Disallow | del* |
| Disallow | con* |
| Disallow | ord* |
| Disallow | fk* |
| Disallow | kri* |
| Disallow | fre* |
| Disallow | log* |
| Disallow | lin* |
| Disallow | acc* |
| Disallow | hel* |
| Disallow | aut* |
| Disallow | paro* |
| Disallow | /pro*/*.* |
| Disallow | search/* |
| Allow | gor*/* |
| Allow | dev*/* |
| Allow | par*/* |
| Allow | tra*/* |
| Allow | bds*/* |
| Allow | vid*/* |
| Allow | cli*/* |
| Allow | *dev*/* |
| Allow | *par*/* |
| Allow | *tra*/* |
| Allow | *bds*/* |
| Allow | *vid*/* |