gadgetreview.com
robots.txt

Robots Exclusion Standard data for gadgetreview.com

Resource Scan

Scan Details

Site Domain gadgetreview.com
Base Domain gadgetreview.com
Scan Status Ok
Last Scan2026-02-07T22:48:49+00:00
Next Scan 2026-02-14T22:48:49+00:00

Last Scan

Scanned2026-02-07T22:48:49+00:00
URL https://gadgetreview.com/robots.txt
Redirect https://www.gadgetreview.com/robots.txt
Redirect Domain www.gadgetreview.com
Redirect Base gadgetreview.com
Domain IPs 104.26.0.60, 104.26.1.60, 172.67.69.153, 2606:4700:20::681a:13c, 2606:4700:20::681a:3c, 2606:4700:20::ac43:4599
Redirect IPs 104.26.0.60, 104.26.1.60, 172.67.69.153, 2606:4700:20::681a:13c, 2606:4700:20::681a:3c, 2606:4700:20::ac43:4599
Response IP 172.67.69.153
Found Yes
Hash 48863be6f2b0032e71419f70215226584b41a9066777f2eacd75eb843f490b3a
SimHash 214d1840ba03

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow go.gadgetreview.com
Disallow get.gadgetreview.com
Disallow cdn.gadgetreview.com
Disallow
Disallow *.webp
Disallow /cdn-cgi/
Disallow /*/1000
Disallow /*/wp-json/
Disallow /tag/
Disallow /*/feed/
Disallow /*/2010/
Disallow /*/2008/
Disallow /*/2009/
Disallow /*/2011/
Disallow /*/2012/
Disallow /*/2013/
Disallow /*/2014/
Disallow /*/2015/
Disallow /*/2016/
Disallow /*/2017/
Disallow /*/2018/
Disallow /*/2019/
Disallow /*/2020/

googlebot-news

Rule Path
Allow /
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-login
Disallow /wp-register.php
Disallow /featured.html

Other Records

Field Value
sitemap https://www.gadgetreview.com/sitemap_index.xml
sitemap https://www.gadgetreview.com/news-sitemap.xml

Comments

  • Prevent private admin areas from being crawled