Log In Sign Up

theappliancedepotoutlet.com
robots.txt

Robots Exclusion Standard data for theappliancedepotoutlet.com

Resource Scan

Scan Details

Site Domain theappliancedepotoutlet.com
Base Domain theappliancedepotoutlet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-09T10:56:07+00:00
Next Scan 2025-01-07T10:56:07+00:00

Last Successful Scan

Scanned2024-05-20T10:52:00+00:00
URL https://theappliancedepotoutlet.com/robots.txt
Domain IPs 104.21.90.53, 172.67.153.133, 2606:4700:3033::ac43:9985, 2606:4700:3037::6815:5a35
Response IP 104.21.90.53
Found Yes
Hash 2c5e4759f9588bc01a23cd2c8526d8a8fb13efaaab24e1bc03580d42f023f59f
SimHash 4c39ca022f8b

Groups

mj12bot
seznambot
yandexbot
mappy
bleriot
tineye-bot
baiduspider
opendi screenshot bot bot@opendi.com
df bot 1.0
yandex
amazonbot
blexbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 240

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 240

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

nimbostratus-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

adsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /vendor/
Disallow /vqmod/
Disallow /tests/
Disallow /ocmod/
Disallow /gtmatrix/
Disallow /admin/*
Disallow /*?page=$
Disallow /*%26page%3D$
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?filter%5Bbrands%5D=
Disallow /*%26filter%5Bbrands%5D%3D
Disallow /*?filter%5Bcategory%5D=
Disallow /*%26filter%5Bcategory%5D%3D
Disallow /*?filter%5Btype%5D=
Disallow /*%26filter%5Btype%5D%3D
Disallow /*?filter%5Bcolor%5D=
Disallow /*%26filter%5Bcolor%5D%3D
Disallow /*?filter%5Bprice%5D=
Disallow /*%26filter%5Bprice%5D%3D
Disallow /*?filter%5Battributes%5D=
Disallow /*%26filter%5Battributes%5D%3D
Disallow /*?attributes_range=
Disallow /*%26attributes_range%3D
Disallow /index.php?route=ripm%2Fcategory%2Fajax_load
Disallow /index.php?route=ripm%2Fcategory%2Fajax_load*
Disallow /index.php?route=ripm%2Fmanufacturer%2Fajax_load
Disallow /index.php?route=ripm%2Fmanufacturer%2Fajax_load*
Disallow /index.php?route=ripm%2Fscratch_and_dent%2Fajax_load
Disallow /index.php?route=ripm%2Fscratch_and_dent%2Fajax_load*
Disallow /index.php?route=ripm%2Fclearance%2Fajax_load
Disallow /index.php?route=ripm%2Fclearance%2Fajax_load*
Disallow /index.php?route=ripm%2Fin_outlet%2Fajax_load
Disallow /index.php?route=ripm%2Fin_outlet%2Fajax_load*
Disallow /index.php?route=ripm%2Ffeatured%2Fajax_load
Disallow /index.php?route=ripm%2Ffeatured%2Fajax_load*
Disallow /index.php?route=ripm%2Frebate%2Fajax_load
Disallow /index.php?route=ripm%2Frebate%2Fajax_load*
Disallow /index.php?route=ripm%2Fsearch*
Disallow /index.php?route=ripm%2Fsearch%2Fajax_load
Disallow /index.php?route=ripm%2Fsearch%2Fajax_load*
Disallow /index.php?route=ripm%2Fmodule%2Ffilter%2Fget_filter
Disallow /index.php?route=ripm%2Fmodule%2Ffilter%2Fget_filter*
Disallow /*ajax_load*
Disallow /index.php?route=ripm%2Fproduct%2Freview*

googlebot

Rule Path
Disallow /*.xls$
Back to top