amb.org
robots.txt
Robots Exclusion Standard data for amb.org
Resource Scan
Scan Details
Site Domain | amb.org |
Base Domain | amb.org |
Scan Status | Ok |
Last Scan | 2024-06-11T07:54:26+00:00 |
Next Scan | 2024-07-11T07:54:26+00:00 |
Last Scan
Scanned | 2024-06-11T07:54:26+00:00 |
URL | https://amb.org/robots.txt |
Redirect | https://www.amb.org/robots.txt |
Redirect Domain | www.amb.org |
Redirect Base | amb.org |
Domain IPs | 50.211.207.106 |
Redirect IPs | 50.211.207.106 |
Response IP | 50.211.207.106 |
Found | Yes |
Hash | aa913bcaaa55c4127f5237cf3e252917988595e71b47398d1e803e80ba761ef5 |
SimHash | 77ad48444eeb |
Groups
linkchecker
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /common |
Disallow | /download |
Disallow | /datasheets |
Disallow | /discog |
Disallow | /audio/results.html |
Disallow | /forum |
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /common |
Disallow | /download |
Disallow | /datasheets |
Disallow | /discog |
Disallow | /audio/results.html |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
Comments