smartphoneblast.com
robots.txt

Robots Exclusion Standard data for smartphoneblast.com

Resource Scan

Scan Details

Site Domain smartphoneblast.com
Base Domain smartphoneblast.com
Scan Status Ok
Last Scan2026-01-01T05:08:47+00:00
Next Scan 2026-01-08T05:08:47+00:00

Last Scan

Scanned2026-01-01T05:08:47+00:00
URL https://smartphoneblast.com/robots.txt
Domain IPs 216.92.28.37
Response IP 216.92.28.37
Found Yes
Hash 8e3f139da79e3a5c0b69c665031d2c46e1a6eefb86abb9bae7ec1f39e6029abc
SimHash 238f2a23f795

Groups

*

Product Comment
* directed to all spiders, not just Scooter
Rule Path
Disallow /cgi-bin/
Disallow /mail.html
Disallow /opinions/
Disallow /images/
Disallow /boards/Private/
Disallow /articles/opinions/
Disallow /articles-SDO-03022011/
Disallow /forums-SDO-OLD/
Disallow /forums/
Disallow /cgi-pub/
Disallow /accessories/
Disallow /*-uo1.html$
Disallow /*-uo2.html$
Disallow /*-uo3.html$
Disallow /*-uo4.html$
Disallow /*-uo5.html$

Other Records

Field Value
crawl-delay 1

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /