wiki.osdev.org
robots.txt
Robots Exclusion Standard data for wiki.osdev.org
Resource Scan
Scan Details
Site Domain | wiki.osdev.org |
Base Domain | osdev.org |
Scan Status | Ok |
Last Scan | 4/2/2025, 8:10:59 PM |
Next Scan | 5/2/2025, 8:10:59 PM |
Last Scan
Scanned | 4/2/2025, 8:10:59 PM |
URL | https://wiki.osdev.org/robots.txt |
Domain IPs | 104.21.69.141, 172.67.209.29, 2606:4700:3034::6815:458d, 2606:4700:3036::ac43:d11d |
Response IP | 172.67.209.29 |
Found | Yes |
Hash | 19be5451d550faec0d4099daffc03cc3e4aa9d012820d3f187d84f4114f9d084 |
SimHash | 21117e24c095 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php |
Disallow | /load.php |
Disallow | /Special%3ASearch |
Disallow | /Special%3ASearch |
Disallow | /Special%3ARandom |
Disallow | /Special%3ARandom |
Disallow | /*.php |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |