blanco.com
robots.txt

Robots Exclusion Standard data for blanco.com

Resource Scan

Scan Details

Site Domain blanco.com
Base Domain blanco.com
Scan Status Ok
Last Scan2024-09-19T08:33:33+00:00
Next Scan 2024-10-19T08:33:33+00:00

Last Scan

Scanned2024-09-19T08:33:33+00:00
URL https://blanco.com/robots.txt
Redirect https://www.blanco.com/robots.txt
Redirect Domain www.blanco.com
Redirect Base blanco.com
Domain IPs 37.131.238.18
Redirect IPs 184.87.193.75, 184.87.193.85
Response IP 23.45.207.166
Found Yes
Hash 9f2680722efde1d86c4b08dc3d568003fe6faa5281f68634a1be5df62f7661c1
SimHash b43c75d5efe9

Groups

*

Rule Path
Disallow /*sink_config__xml_.xml$
Disallow /*xml_opk_urls.xml$
Disallow /de/data/
Disallow /uk/data/
Disallow /de_ch/data/
Disallow /at/data/
Disallow /int/data/
Disallow /fr/data/
Disallow /fr_ch/data/
Disallow /fr_be/data/
Disallow /ru/data/
Disallow /fl_be/data/
Disallow /ua/data/
Disallow /es/data/
Disallow /nl/data/
Disallow /it/data/
Disallow /hu/data/
Disallow /ro/data/
Disallow /en_cn/data/
Disallow /zh_cn/data/
Disallow /en_us/data/
Disallow /en_ca/data/
Disallow /fr_ca/data/
Disallow /pl/data/
Disallow /blancostorefront/*/cart
Disallow /blancostorefront/*/checkout
Disallow /blancostorefront/*/my-account

cazoodlebot

Rule Path
Disallow /blancostorefront/

mj12bot

Rule Path
Disallow /blancostorefront/

dotbot/1.0

Rule Path
Disallow /blancostorefront/

gigabot

Rule Path
Disallow /blancostorefront/

semrushbot

Rule Path
Disallow /blancostorefront/

semrushbot-sa

Rule Path
Disallow /blancostorefront/

amazonbot

Rule Path
Disallow /blancostorefront/

Other Records

Field Value
sitemap https://www.blanco.com/int-en/xml-sitemap.xml
sitemap https://www.blanco.com/cn-zh/xml-sitemap.xml
sitemap https://www.blanco.com/at-de/xml-sitemap.xml
sitemap https://www.blanco.com/ca-en/xml-sitemap.xml
sitemap https://www.blanco.com/ca-fr/xml-sitemap.xml
sitemap https://www.blanco.com/us-en/xml-sitemap.xml
sitemap https://www.blanco.com/ch-de/xml-sitemap.xml
sitemap https://www.blanco.com/ch-fr/xml-sitemap.xml
sitemap https://www.blanco.com/fr-fr/xml-sitemap.xml
sitemap https://www.blanco.com/be-nl/xml-sitemap.xml
sitemap https://www.blanco.com/be-fr/xml-sitemap.xml
sitemap https://www.blanco.com/ua-uk/xml-sitemap.xml
sitemap https://www.blanco.com/es-es/xml-sitemap.xml
sitemap https://www.blanco.com/pt-pt/xml-sitemap.xml
sitemap https://www.blanco.com/cz-cs/xml-sitemap.xml
sitemap https://www.blanco.com/pl-pl/xml-sitemap.xml
sitemap https://www.blanco.com/hu-hu/xml-sitemap.xml
sitemap https://www.blanco.com/it-it/xml-sitemap.xml
sitemap https://www.blanco.com/nl-nl/xml-sitemap.xml
sitemap https://www.blanco.com/au-en/xml-sitemap.xml
sitemap https://www.blanco.com/jp-ja/xml-sitemap.xml

Comments

  • Block access to specific groups of pages
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Block SemrushBot
  • Block SemrushBot-SA
  • Block Amazonbot