radiopaedia.org
robots.txt
Robots Exclusion Standard data for radiopaedia.org
Resource Scan
Scan Details
Site Domain | radiopaedia.org |
Base Domain | radiopaedia.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-13T01:22:11+00:00 |
Next Scan | 2024-09-27T01:22:11+00:00 |
Last Successful Scan
Scanned | 2024-08-28T21:10:04+00:00 |
URL | https://radiopaedia.org/robots.txt |
Domain IPs | 104.22.36.235, 104.22.37.235, 172.67.21.164, 2606:4700:10::6816:24eb, 2606:4700:10::6816:25eb, 2606:4700:10::ac43:15a4 |
Response IP | 104.22.37.235 |
Found | Yes |
Hash | ecd37da3530b567471353a0217c02d2b5cad7df66399cdbdd3aca646ba3a0ebf |
SimHash | c4005c478a97 |
Groups
*
Rule | Path |
---|---|
Disallow | /questions/ |
Disallow | /search/ |
Disallow | /tags/ |
Disallow | /playlists/ |
Disallow | /admin |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://radiopaedia.org/sitemap?lang=us |