brecks.com
robots.txt

Robots Exclusion Standard data for brecks.com

Resource Scan

Scan Details

Site Domain brecks.com
Base Domain brecks.com
Scan Status Ok
Last Scan2024-06-09T03:58:00+00:00
Next Scan 2024-07-09T03:58:00+00:00

Last Scan

Scanned2024-06-09T03:58:00+00:00
URL https://brecks.com/robots.txt
Redirect https://www.brecks.com/robots.txt
Redirect Domain www.brecks.com
Redirect Base brecks.com
Domain IPs 162.248.104.127
Redirect IPs 3.227.221.104
Response IP 3.227.221.104
Found Yes
Hash 2aa34bc305704cd54ad6063d64869647c233c76d625ff66ff48f69a1317d5684
SimHash 284c8a946112

Groups

fatbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /free40
Disallow /Free40
Disallow /FREE40
Disallow /affiliate
Disallow /eparty*
Disallow /referafriend*
Disallow /subscriptions*
Disallow /view_reviews/*
Disallow /category_filter/*
Disallow /category_sort/*
Disallow /minicart*
Disallow /become_an_affiliate
Disallow /product/*?quickview=true
Disallow /category/s?keyword=*
Disallow /search?keyword=*
Disallow /fullsize/*
Disallow /*.gz

Other Records

Field Value
sitemap https://www.brecks.com/downloads/index-sitemap.xml