bsbi.org
robots.txt
Robots Exclusion Standard data for bsbi.org
Resource Scan
Scan Details
Site Domain | bsbi.org |
Base Domain | bsbi.org |
Scan Status | Ok |
Last Scan | 2025-10-15T11:11:42+00:00 |
Next Scan | 2025-10-22T11:11:42+00:00 |
Last Scan
Scanned | 2025-10-15T11:11:42+00:00 |
URL | https://bsbi.org/robots.txt |
Domain IPs | 104.21.67.98, 172.67.220.73, 2606:4700:3034::6815:4362, 2606:4700:3035::ac43:dc49 |
Response IP | 172.67.220.73 |
Found | Yes |
Hash | a69faa42036bb6bd33fce005454990f9623fdb431d90cc38acc32a6c58a7e99c |
SimHash | 3333ccb65403 |
Groups
*
Rule | Path |
---|---|
Disallow | /go/ |
Disallow | /private |
Disallow | /taxon |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /?s= |
Disallow | /payment-notification |
Disallow | /payment-mandate |
Disallow | /payment-result |
Disallow | /download/23989 |
Other Records
Field | Value |
---|---|
sitemap | https://bsbi.org/sitemap.xml |
Comments