Log In Sign Up

masrefacciones.mx
robots.txt

Robots Exclusion Standard data for masrefacciones.mx

Resource Scan

Scan Details

Site Domain masrefacciones.mx
Base Domain masrefacciones.mx
Scan Status Ok
Last Scan2024-10-17T05:20:16+00:00
Next Scan 2024-11-16T05:20:16+00:00

Last Scan

Scanned2024-10-17T05:20:16+00:00
URL https://www.masrefacciones.mx/robots.txt
Domain IPs 13.226.2.34, 13.226.2.40, 13.226.2.52, 13.226.2.58, 2600:9000:2022:2600:16:ba71:3300:93a1, 2600:9000:2022:4800:16:ba71:3300:93a1, 2600:9000:2022:6400:16:ba71:3300:93a1, 2600:9000:2022:8000:16:ba71:3300:93a1, 2600:9000:2022:8600:16:ba71:3300:93a1, 2600:9000:2022:b000:16:ba71:3300:93a1, 2600:9000:2022:bc00:16:ba71:3300:93a1, 2600:9000:2022:e400:16:ba71:3300:93a1
Response IP 108.156.22.83
Found Yes
Hash 707069f0049c14002d965b38a0a7978d2162dbea360cf66109d1a93e0c6c0e33
SimHash ecb1fc9f7c95

Groups

googlebot

Rule Path
Disallow /?s=
Disallow /ps%3D*
Disallow *?ft=*
Disallow *search?fq=*
Disallow *Site/Track.aspx?*
Disallow *buscavazia?ft*
Disallow *produto/sku/*
Disallow *welcome?*
Disallow *no-cache*
Disallow *checkout*
Disallow *backoffice*
Disallow *Sistema/404*

googlebot-image

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap http://www.masrefacciones.mx/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
Back to top