bikerforums.org
robots.txt
Robots Exclusion Standard data for bikerforums.org
Resource Scan
Scan Details
| Site Domain | bikerforums.org |
| Base Domain | bikerforums.org |
| Scan Status | Ok |
| Last Scan | 2025-10-12T00:59:02+00:00 |
| Next Scan | 2025-10-19T00:59:02+00:00 |
Last Scan
| Scanned | 2025-10-12T00:59:02+00:00 |
| URL | https://bikerforums.org/robots.txt |
| Domain IPs | 104.21.82.37, 172.67.152.168, 2606:4700:3030::6815:5225, 2606:4700:3030::ac43:98a8 |
| Response IP | 104.21.82.37 |
| Found | Yes |
| Hash | 74b8dcca008ca4df96e1a2bcf8244fbe09d24f4cb7c679aae6bcd5f5b5d1aa53 |
| SimHash | 671d984187d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sendmessage.php |
| Disallow | /subscription.php |
| Disallow | /printthread.php |
| Disallow | */attachments/*dl |
| Disallow | /search.php |
| Disallow | /esp_search.php |
| Disallow | /members/ |
| Disallow | /login.php |
| Disallow | /post_thanks.php |
| Disallow | /members/list/ |
| Disallow | /tags.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bikerforums.org/sitemap_index.xml.gz |