petrowiki.spe.org
robots.txt
Robots Exclusion Standard data for petrowiki.spe.org
Resource Scan
Scan Details
| Site Domain | petrowiki.spe.org |
| Base Domain | spe.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-18T17:38:16+00:00 |
| Next Scan | 2025-10-16T17:38:16+00:00 |
Last Successful Scan
| Scanned | 2025-02-26T11:37:28+00:00 |
| URL | https://petrowiki.spe.org/robots.txt |
| Domain IPs | 20.85.238.116 |
| Response IP | 20.85.238.116 |
| Found | Yes |
| Hash | c8afa0c34e17525268e9fc149c9404186fe1dd5405faa662d97257b14e719651 |
| SimHash | f9009b20d5d8 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /w/load.php? |
| Allow | /w/resources |
| Allow | /w/skins |
| Allow | /w/extensions |
| Disallow | /w/ |
| Disallow | /Special%3A |
| Disallow | /wiki/Special%3A |
| Disallow | /MediaWiki%3A |
| Disallow | /wiki/MediaWiki%3A |