Log In Sign Up

bascoappliances.com
robots.txt

Robots Exclusion Standard data for bascoappliances.com

Resource Scan

Scan Details

Site Domain bascoappliances.com
Base Domain bascoappliances.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-07T21:55:16+00:00
Next Scan 2025-01-05T21:55:16+00:00

Last Successful Scan

Scanned2024-05-18T20:18:52+00:00
URL https://bascoappliances.com/robots.txt
Domain IPs 104.21.96.11, 172.67.171.242, 2606:4700:3030::6815:600b, 2606:4700:3034::ac43:abf2
Response IP 104.21.96.11
Found Yes
Hash 09d8a1c156947e949555cb4c26033ceb6871f2ef3c649ac0da02a2832cd8d07e
SimHash 4c39ca022f8b

Groups

mj12bot
seznambot
yandexbot
mappy
bleriot
tineye-bot
baiduspider
opendi screenshot bot bot@opendi.com
df bot 1.0
yandex
amazonbot
blexbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 240

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 240

serpstatbot
duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

nimbostratus-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

adsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /vendor/
Disallow /vqmod/
Disallow /tests/
Disallow /ocmod/
Disallow /gtmatrix/
Disallow /admin/*
Disallow /*?page=$
Disallow /*%26page%3D$
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?filter%5Bbrands%5D=
Disallow /*%26filter%5Bbrands%5D%3D
Disallow /*?filter%5Bcategory%5D=
Disallow /*%26filter%5Bcategory%5D%3D
Disallow /*?filter%5Btype%5D=
Disallow /*%26filter%5Btype%5D%3D
Disallow /*?filter%5Bcolor%5D=
Disallow /*%26filter%5Bcolor%5D%3D
Disallow /*?filter%5Bprice%5D=
Disallow /*%26filter%5Bprice%5D%3D
Disallow /*?filter%5Battributes%5D=
Disallow /*%26filter%5Battributes%5D%3D
Disallow /*?attributes_range=
Disallow /*%26attributes_range%3D
Disallow /index.php?route=ripm%2Fcategory%2Fajax_load
Disallow /index.php?route=ripm%2Fcategory%2Fajax_load*
Disallow /index.php?route=ripm%2Fmanufacturer%2Fajax_load
Disallow /index.php?route=ripm%2Fmanufacturer%2Fajax_load*
Disallow /index.php?route=ripm%2Fscratch_and_dent%2Fajax_load
Disallow /index.php?route=ripm%2Fscratch_and_dent%2Fajax_load*
Disallow /index.php?route=ripm%2Fclearance%2Fajax_load
Disallow /index.php?route=ripm%2Fclearance%2Fajax_load*
Disallow /index.php?route=ripm%2Fin_outlet%2Fajax_load
Disallow /index.php?route=ripm%2Fin_outlet%2Fajax_load*
Disallow /index.php?route=ripm%2Ffeatured%2Fajax_load
Disallow /index.php?route=ripm%2Ffeatured%2Fajax_load*
Disallow /index.php?route=ripm%2Frebate%2Fajax_load
Disallow /index.php?route=ripm%2Frebate%2Fajax_load*
Disallow /index.php?route=ripm%2Fsearch*
Disallow /index.php?route=ripm%2Fsearch%2Fajax_load
Disallow /index.php?route=ripm%2Fsearch%2Fajax_load*
Disallow /index.php?route=ripm%2Fmodule%2Ffilter%2Fget_filter
Disallow /index.php?route=ripm%2Fmodule%2Ffilter%2Fget_filter*
Disallow /*ajax_load*
Disallow /index.php?route=ripm%2Fproduct%2Freview*

googlebot

Rule Path
Disallow /*.xls$
Back to top

Warnings

  • 1 invalid line.
Back to top