gadgetblast.com
robots.txt
Robots Exclusion Standard data for gadgetblast.com
Resource Scan
Scan Details
| Site Domain | gadgetblast.com |
| Base Domain | gadgetblast.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-12-06T16:06:38+00:00 |
| Next Scan | 2026-03-06T16:06:38+00:00 |
Last Successful Scan
| Scanned | 2025-04-18T01:37:43+00:00 |
| URL | https://gadgetblast.com/robots.txt |
| Redirect | https://www.smartphoneblast.com/robots.txt |
| Redirect Domain | www.smartphoneblast.com |
| Redirect Base | smartphoneblast.com |
| Domain IPs | 216.92.28.37 |
| Redirect IPs | 216.92.28.37 |
| Response IP | 216.92.28.37 |
| Found | Yes |
| Hash | 8e3f139da79e3a5c0b69c665031d2c46e1a6eefb86abb9bae7ec1f39e6029abc |
| SimHash | 238f2a23f795 |
Groups
*
| Product | Comment |
|---|---|
| * | directed to all spiders, not just Scooter |
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /mail.html |
| Disallow | /opinions/ |
| Disallow | /images/ |
| Disallow | /boards/Private/ |
| Disallow | /articles/opinions/ |
| Disallow | /articles-SDO-03022011/ |
| Disallow | /forums-SDO-OLD/ |
| Disallow | /forums/ |
| Disallow | /cgi-pub/ |
| Disallow | /accessories/ |
| Disallow | /*-uo1.html$ |
| Disallow | /*-uo2.html$ |
| Disallow | /*-uo3.html$ |
| Disallow | /*-uo4.html$ |
| Disallow | /*-uo5.html$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |