bunspace.com
robots.txt
Robots Exclusion Standard data for bunspace.com
Resource Scan
Scan Details
| Site Domain | bunspace.com |
| Base Domain | bunspace.com |
| Scan Status | Ok |
| Last Scan | 2026-02-08T15:35:36+00:00 |
| Next Scan | 2026-02-15T15:35:36+00:00 |
Last Scan
| Scanned | 2026-02-08T15:35:36+00:00 |
| URL | https://www.bunspace.com/robots.txt |
| Domain IPs | 74.208.253.25 |
| Response IP | 74.208.253.25 |
| Found | Yes |
| Hash | 1883ca31a2945edd8d79ef460b0812321c1a299367c33fabd18374bf47231240 |
| SimHash | 2c719f7156d1 |
Groups
slurp
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /search |
| Disallow | /shelter/local |
| Disallow | /contest_vote |
| Disallow | /editNote |
| Disallow | /doSearch |
| Disallow | /mobile/registration |
| Disallow | /product_commercial_redirect |
| Disallow | /product_commercial_banner_redirect |
| Disallow | /url_forward |
| Disallow | /message_admin |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /search |
| Disallow | /shelter/local |
| Disallow | /contest_vote |
| Disallow | /editNote |
| Disallow | /doSearch |
| Disallow | /mobile/ |
| Disallow | /product_commercial_redirect |
| Disallow | /product_commercial_banner_redirect |
| Disallow | /url_forward |
| Disallow | /message_admin |
| Disallow | /registration/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /shelter/local |
| Disallow | /contest_vote |
| Disallow | /editNote |
| Disallow | /mobile/ |
| Disallow | /product_commercial_redirect |
| Disallow | /product_commercial_banner_redirect |
| Disallow | /url_forward |
| Disallow | /message_admin |
| Disallow | /registration/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /shelter/local |
| Disallow | /contest_vote |
| Disallow | /editNote |
| Disallow | /mobile/ |
| Disallow | /product_commercial_redirect |
| Disallow | /product_commercial_banner_redirect |
| Disallow | /url_forward |
| Disallow | /message_admin |
| Disallow | /registration/ |
msnbot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /search |
| Disallow | /shelter/local |
| Disallow | /contest_vote |
| Disallow | /editNote |
| Disallow | /doSearch |
| Disallow | /mobile/registration |
| Disallow | /product_commercial_redirect |
| Disallow | /product_commercial_banner_redirect |
| Disallow | /url_forward |
| Disallow | /message_admin |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | / |