megaputa.ru
robots.txt
Robots Exclusion Standard data for megaputa.ru
Resource Scan
Scan Details
Site Domain | megaputa.ru |
Base Domain | megaputa.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-27T18:37:40+00:00 |
Next Scan | 2025-01-25T18:37:40+00:00 |
Last Successful Scan
Scanned | 2023-09-11T17:05:15+00:00 |
URL | https://megaputa.ru/robots.txt |
Redirect | https://interputa.ru/robots.txt |
Redirect Domain | interputa.ru |
Redirect Base | interputa.ru |
Domain IPs | 104.21.35.146, 172.67.176.182, 2606:4700:3034::6815:2392, 2606:4700:3034::ac43:b0b6 |
Redirect IPs | 104.21.15.159, 172.67.163.27, 2606:4700:3030::6815:f9f, 2606:4700:3031::ac43:a31b |
Response IP | 104.21.15.159 |
Found | Yes |
Hash | b1406b389725f6744b8142f0507263fc2d159c38417973fe5b0e9904f14511fd |
SimHash | b5a83295e2bd |
Groups
*
Rule | Path |
---|---|
Disallow | fot*/* |
Disallow | ph*/* |
Disallow | /pro*/*.* |
Disallow | all/* |
Disallow | *all/* |
Disallow | ad* |
Disallow | ch* |
Disallow | aut* |
Disallow | ca* |
Disallow | re* |
Disallow | sup* |
Disallow | del* |
Disallow | con* |
Disallow | ord* |
Disallow | fk* |
Disallow | kri* |
Disallow | fre* |
Disallow | log* |
Disallow | lin* |
Disallow | acc* |
Disallow | hel* |
Disallow | aut* |
Disallow | paro* |
Disallow | /pro*/*.* |
Disallow | search/* |
Allow | gor*/* |
Allow | dev*/* |
Allow | par*/* |
Allow | tra*/* |
Allow | bds*/* |
Allow | vid*/* |
Allow | cli*/* |
Allow | *dev*/* |
Allow | *par*/* |
Allow | *tra*/* |
Allow | *bds*/* |
Allow | *vid*/* |