hestia.jmrl.org
robots.txt
Robots Exclusion Standard data for hestia.jmrl.org
Resource Scan
Scan Details
Site Domain | hestia.jmrl.org |
Base Domain | jmrl.org |
Scan Status | Ok |
Last Scan | 2024-11-03T16:04:59+00:00 |
Next Scan | 2024-12-03T16:04:59+00:00 |
Last Scan
Scanned | 2024-11-03T16:04:59+00:00 |
URL | https://hestia.jmrl.org/robots.txt |
Domain IPs | 69.16.201.28 |
Response IP | 69.16.201.28 |
Found | Yes |
Hash | 46b713f21a2166141c648066410b035fd412de421f16bb575599fe12a6aaefca |
SimHash | 6a5845c3a691 |
Groups
*
Rule | Path |
---|---|
Disallow | /findit/AJAX |
Disallow | /findit/Alphabrowse |
Disallow | /findit/Browse |
Disallow | /findit/Combined |
Disallow | /findit/Search/Results |
Disallow | /findit/Summon |
Disallow | /findit/SummonRecord |
Disallow | /findit/AJAX/ |
Disallow | /findit/Alphabrowse/ |
Disallow | /findit/Browse/ |
Disallow | /findit/Combined/ |
Disallow | /findit/Search/Results/ |
Disallow | /findit/Summon/ |
Disallow | /findit/SummonRecord/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |