uesp.net
robots.txt
Robots Exclusion Standard data for uesp.net
Resource Scan
Scan Details
Site Domain | uesp.net |
Base Domain | uesp.net |
Scan Status | Ok |
Last Scan | 2024-06-12T00:50:25+00:00 |
Next Scan | 2024-06-19T00:50:25+00:00 |
Last Scan
Scanned | 2024-06-12T00:50:25+00:00 |
URL | https://uesp.net/robots.txt |
Redirect | https://en.uesp.net/robots.txt |
Redirect Domain | en.uesp.net |
Redirect Base | uesp.net |
Domain IPs | 107.161.64.229 |
Redirect IPs | 107.161.64.229 |
Response IP | 107.161.64.229 |
Found | Yes |
Hash | 9127fd70c6bde2eafe129719ac4083c4814bd053390092c9f7013cce7954d2f8 |
SimHash | f1209820e391 |
Groups
*
Rule | Path |
---|---|
Disallow | /counter/ |
Disallow | /images/ |
Disallow | /backup/ |
Disallow | /*etmaplocs.php |
Disallow | /w/load.php? |
Disallow | /w/ |
Disallow | /wiki/Special%3A* |
Disallow | /wiki/Special%3A* |
Disallow | /w14/ |
Disallow | /phpbb3/ |
Disallow | /phpbb3.test/ |
Disallow | /oblivion/cs/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |