wiki.osdev.org
robots.txt

Robots Exclusion Standard data for wiki.osdev.org

Resource Scan

Scan Details

Site Domain wiki.osdev.org
Base Domain osdev.org
Scan Status Ok
Last Scan4/2/2025, 8:10:59 PM
Next Scan 5/2/2025, 8:10:59 PM

Last Scan

Scanned4/2/2025, 8:10:59 PM
URL https://wiki.osdev.org/robots.txt
Domain IPs 104.21.69.141, 172.67.209.29, 2606:4700:3034::6815:458d, 2606:4700:3036::ac43:d11d
Response IP 172.67.209.29
Found Yes
Hash 19be5451d550faec0d4099daffc03cc3e4aa9d012820d3f187d84f4114f9d084
SimHash 21117e24c095

Groups

*

Rule Path
Disallow /index.php
Disallow /load.php
Disallow /Special%3ASearch
Disallow /Special%3ASearch
Disallow /Special%3ARandom
Disallow /Special%3ARandom
Disallow /*.php

Other Records

Field Value
crawl-delay 15