peter-murray.net
robots.txt
Robots Exclusion Standard data for peter-murray.net
Resource Scan
Scan Details
| Site Domain | peter-murray.net |
| Base Domain | peter-murray.net |
| Scan Status | Ok |
| Last Scan | 2026-01-05T03:37:15+00:00 |
| Next Scan | 2026-01-12T03:37:15+00:00 |
Last Scan
| Scanned | 2026-01-05T03:37:15+00:00 |
| URL | https://peter-murray.net/robots.txt |
| Domain IPs | 45.66.10.58 |
| Response IP | 45.66.10.58 |
| Found | Yes |
| Hash | 92c38bc8afcc6689da7624c04664bfbb5bed9d1e8909b2b9c627033d43045ae3 |
| SimHash | 750bb873c133 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /engine/download.php |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /lastnews/ |
| Disallow | /statistics.html |
| Disallow | /abuse.html |
| Disallow | /support.html |
| Disallow | /rules.html |
| Disallow | /comments-rules.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*do%3Dmegasearch |
| Disallow | */?filter=* |
| Disallow | /year/*-* |
| Disallow | /megasearch/ |
| Disallow | /continue/ |
| Disallow | /favorites/ |
| Disallow | /tags/* |
| Disallow | */page/* |
| Disallow | /2012/ |
| Disallow | /2013/ |
| Disallow | /2014/ |
| Disallow | /2015/ |
| Disallow | /2016/ |
| Disallow | /2017/ |
| Disallow | /2018/ |
| Disallow | /2019/ |
| Disallow | /thumb.php* |
| Disallow | *?$ |
yandex
| Rule | Path |
|---|---|
| Disallow | */amp.html |
| Disallow | */page/* |
| Disallow | /engine/go.php |
| Disallow | /engine/download.php |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /lastnews/ |
| Disallow | /statistics.html |
| Disallow | /abuse.html |
| Disallow | /support.html |
| Disallow | /rules.html |
| Disallow | /comments-rules.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*do%3Dmegasearch |
| Disallow | */?filter=* |
| Disallow | /year/*-* |
| Disallow | /megasearch/ |
| Disallow | /continue/ |
| Disallow | /favorites/ |
| Disallow | /tags/* |
| Disallow | /2012/ |
| Disallow | /2013/ |
| Disallow | /2014/ |
| Disallow | /2015/ |
| Disallow | /2016/ |
| Disallow | /2017/ |
| Disallow | /2018/ |
| Disallow | /2022/ |
| Disallow | /thumb.php* |
| Disallow | *?$ |
Warnings
- `host` is not a known field.