androidblast.com
robots.txt
Robots Exclusion Standard data for androidblast.com
Resource Scan
Scan Details
| Site Domain | androidblast.com |
| Base Domain | androidblast.com |
| Scan Status | Ok |
| Last Scan | 2025-12-04T05:07:59+00:00 |
| Next Scan | 2026-01-03T05:07:59+00:00 |
Last Scan
| Scanned | 2025-12-04T05:07:59+00:00 |
| URL | https://androidblast.com/robots.txt |
| Redirect | https://www.smartphoneblast.com/robots.txt |
| Redirect Domain | www.smartphoneblast.com |
| Redirect Base | smartphoneblast.com |
| Domain IPs | 216.92.28.37 |
| Redirect IPs | 216.92.28.37 |
| Response IP | 216.92.28.37 |
| Found | Yes |
| Hash | 8e3f139da79e3a5c0b69c665031d2c46e1a6eefb86abb9bae7ec1f39e6029abc |
| SimHash | 238f2a23f795 |
Groups
*
| Product | Comment |
|---|---|
| * | directed to all spiders, not just Scooter |
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /mail.html |
| Disallow | /opinions/ |
| Disallow | /images/ |
| Disallow | /boards/Private/ |
| Disallow | /articles/opinions/ |
| Disallow | /articles-SDO-03022011/ |
| Disallow | /forums-SDO-OLD/ |
| Disallow | /forums/ |
| Disallow | /cgi-pub/ |
| Disallow | /accessories/ |
| Disallow | /*-uo1.html$ |
| Disallow | /*-uo2.html$ |
| Disallow | /*-uo3.html$ |
| Disallow | /*-uo4.html$ |
| Disallow | /*-uo5.html$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |