Log In Sign Up

lookbuck.com
robots.txt

Robots Exclusion Standard data for lookbuck.com

Resource Scan

Scan Details

Site Domain lookbuck.com
Base Domain lookbuck.com
Scan Status Ok
Last Scan2024-06-15T18:37:01+00:00
Next Scan 2024-06-22T18:37:01+00:00

Last Scan

Scanned2024-06-15T18:37:01+00:00
URL https://lookbuck.com/robots.txt
Domain IPs 104.21.95.251, 172.67.171.231, 2606:4700:3035::6815:5ffb, 2606:4700:3037::ac43:abe7
Response IP 104.21.95.251
Found Yes
Hash eaec6b825712f573338d9fdbd6ae9c8a00bada262aefb2ad1fbe1e728f25e80e
SimHash 31052d9fa754

Groups

googlebot

Rule Path
Disallow /p/*
Disallow /shops/*
Disallow /products
Disallow /users
Disallow /en/
Disallow /*/chernyi
Disallow /*/belyi
Disallow /*/krasnyi
Disallow /*/sinii
Disallow /*/korichnevyi
Disallow /*/serebristyi
Disallow /*/raznotsvetnyi
Disallow /*/oranzhevyi
Disallow /*/seryi
Disallow /*/zelenyi
Disallow /*/rozovyi
Disallow /*/zheltyi
Disallow /*/goluboi
Disallow /*/bezhevyi
Disallow /*/fioletovyi
Disallow /promo
Disallow /widgets
Disallow /language
Disallow /search
Disallow /clothes/
Disallow /cat_check
Disallow /check_fill
Disallow /us/s-chem-nosit
Disallow /s-chem-nosit
Disallow /*?*color=*
Disallow /*?*sort=*
Disallow /*locale%3Dru*
Disallow /*locale%3Den*
Disallow /*locale%3Dus*
Allow /stages.json

*

Rule Path
Disallow /p/*
Disallow /catalog?*
Disallow /products
Disallow /users
Disallow /en/
Disallow /promo
Disallow /widgets
Disallow /language
Disallow /search
Disallow /clothes/
Disallow /cat_check
Disallow /check_fill
Disallow /us/s-chem-nosit
Disallow /s-chem-nosit
Disallow /*?*color=*
Disallow /*?*sort=*
Disallow /*locale%3Dru*
Disallow /*locale%3Den*
Disallow /*locale%3Dus*
Disallow /us/
Allow /stages.json
Back to top

Other Records

Field Value
sitemap https://lookbuck.com/system/sitemap.xml.gz
sitemap https://lookbuck.com/system/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top