shaveroutlet.com
robots.txt

Robots Exclusion Standard data for shaveroutlet.com

Resource Scan

Scan Details

Site Domain shaveroutlet.com
Base Domain shaveroutlet.com
Scan Status Ok
Last Scan2026-01-11T04:01:30+00:00
Next Scan 2026-02-10T04:01:30+00:00

Last Scan

Scanned2026-01-11T04:01:30+00:00
URL https://shaveroutlet.com/robots.txt
Domain IPs 104.26.4.3, 104.26.5.3, 172.67.71.81, 2606:4700:20::681a:403, 2606:4700:20::681a:503, 2606:4700:20::ac43:4751
Response IP 172.67.71.81
Found Yes
Hash df6c0083ba246ba1c13303813915a086eb9a687e458f1ef56d7b7e79a323535d
SimHash 6034d81067f2

Groups

sogou spider

Rule Path
Disallow /

googlebot

Rule Path
Allow /catalog/product/view/id/
Allow /catalogsearch/result/
Allow *fee%3D1*
Allow /catalogue/?manufacturer=*
Allow /repair-services.html
Disallow /catalogsearch/result/*q%3D*.com*
Disallow /media/catalog/product/cache/*/small_image/*.jpg$
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /tag/
Disallow /catalogsearch/
Disallow /review/
Disallow /app/
Disallow /downloader/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /skin/
Disallow /var/
Disallow /customer/

googlebot-image

Rule Path
Disallow /media/catalog/product/cache/*/small_image/*.jpg$

bingbot

Rule Path
Allow /
Allow /catalogue/
Allow /media/
Allow /google/
Allow /cdn/
Allow /*.html$
Allow *fee%3D5*
Disallow /*?
Disallow /checkout/
Disallow /tag/
Disallow /catalogsearch/
Disallow /review/
Disallow /app/
Disallow /downloader/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /skin/
Disallow /var/
Disallow /customer/

*

Rule Path
Allow /repair-services.html
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /tag/
Disallow /catalogsearch/
Disallow /review/
Disallow /app/
Disallow /downloader/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /skin/
Disallow /var/
Disallow /customer/