petrowiki.org
robots.txt
Robots Exclusion Standard data for petrowiki.org
Resource Scan
Scan Details
Site Domain | petrowiki.org |
Base Domain | petrowiki.org |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2025-07-11T05:21:36+00:00 |
Next Scan | 2025-10-09T05:21:36+00:00 |
Last Successful Scan
Scanned | 2025-02-19T05:12:57+00:00 |
URL | https://petrowiki.org/robots.txt |
Redirect | https://petrowiki.spe.org/robots.txt |
Redirect Domain | petrowiki.spe.org |
Redirect Base | spe.org |
Domain IPs | 20.85.238.116 |
Response IP | 20.85.238.116 |
Found | Yes |
Hash | c8afa0c34e17525268e9fc149c9404186fe1dd5405faa662d97257b14e719651 |
SimHash | f9009b20d5d8 |
Groups
*
Rule | Path |
---|---|
Allow | /w/load.php? |
Allow | /w/resources |
Allow | /w/skins |
Allow | /w/extensions |
Disallow | /w/ |
Disallow | /Special%3A |
Disallow | /wiki/Special%3A |
Disallow | /MediaWiki%3A |
Disallow | /wiki/MediaWiki%3A |