en.uesp.net
robots.txt
Robots Exclusion Standard data for en.uesp.net
Resource Scan
Scan Details
Site Domain | en.uesp.net |
Base Domain | uesp.net |
Scan Status | Ok |
Last Scan | 2024-11-07T04:58:33+00:00 |
Next Scan | 2024-11-21T04:58:33+00:00 |
Last Scan
Scanned | 2024-11-07T04:58:33+00:00 |
URL | https://en.uesp.net/robots.txt |
Domain IPs | 107.161.64.229 |
Response IP | 107.161.64.229 |
Found | Yes |
Hash | f249aa6a72ae93ed6674d3e423faa656aba9f7711cc2a7bf03ad91d3c032feda |
SimHash | 73309824c391 |
Groups
*
Rule | Path |
---|---|
Disallow | /counter/ |
Disallow | /images/ |
Disallow | /backup/ |
Disallow | /*etmaplocs.php |
Disallow | /w/load.php |
Disallow | /w/index.php |
Disallow | /w/ |
Disallow | /wiki/Special%3A* |
Disallow | /wiki/Special%3A* |
Disallow | /w14/ |
Disallow | /phpbb3/ |
Disallow | /phpbb3.test/ |
Disallow | /oblivion/cs/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |