Log In Sign Up

benjaminmoore.mx
robots.txt

Robots Exclusion Standard data for benjaminmoore.mx

Resource Scan

Scan Details

Site Domain benjaminmoore.mx
Base Domain benjaminmoore.mx
Scan Status Ok
Last Scan2025-10-07T08:11:55+00:00
Next Scan 2025-11-06T08:11:55+00:00

Last Scan

Scanned2025-10-07T08:11:55+00:00
URL https://benjaminmoore.mx/robots.txt
Redirect https://www.benjaminmoore.mx/robots.txt
Redirect Domain www.benjaminmoore.mx
Redirect Base benjaminmoore.mx
Domain IPs 23.210.102.145
Redirect IPs 23.210.102.145, 2600:1413:5000:a81::15ab, 2600:1413:5000:a8e::15ab
Response IP 23.14.199.45
Found Yes
Hash 53d79ffd2f599cdbd14662ad03f98de0ea2d8e6884972912492199629c6033b3
SimHash 2908082a6338

Groups

*

Rule Path
Disallow

taginspector

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /
Disallow /*?*color
Disallow /*?sl*
Disallow /*?targetclass*
Disallow /*/profile/*
Disallow /*/profil/*
Disallow /akamai/
Disallow /api/
Disallow /errorlog/
Disallow /layouts/
Disallow /monitoring/
Disallow /sitecore/
Disallow /sitecore_files/
Disallow /temp/
Disallow /upload/
Disallow /500.html
Disallow /*/search
Disallow /*rendercontent

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.benjaminmoore.mx/sitemap.xml
Back to top

Comments

  • Block Parameters
  • Block Profile
  • Block TargetClass
Back to top

Warnings

  • 3 invalid lines.
Back to top