menuprecios.mx
robots.txt

Robots Exclusion Standard data for menuprecios.mx

Resource Scan

Scan Details

Site Domain menuprecios.mx
Base Domain menuprecios.mx
Scan Status Ok
Last Scan2024-09-26T17:38:59+00:00
Next Scan 2024-10-03T17:38:59+00:00

Last Scan

Scanned2024-09-26T17:38:59+00:00
URL https://menuprecios.mx/robots.txt
Redirect https://www.menuprecios.mx/robots.txt
Redirect Domain www.menuprecios.mx
Redirect Base menuprecios.mx
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.142, 76.76.21.98
Response IP 76.76.21.142
Found Yes
Hash a7bcc6c0c6466259fc76fe370c9884259a363d791de721a4e29b621895d310f1
SimHash 584cda62eeb1

Groups

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

photon

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /api/*
Disallow /about
Disallow /privacy
Disallow /terms
Disallow /dmca
Disallow /contact
Allow /

Other Records

Field Value
sitemap https://www.menuprecios.mx/sitemap/sitemap-main.xml