aspel.com
robots.txt

Robots Exclusion Standard data for aspel.com

Resource Scan

Scan Details

Site Domain aspel.com
Base Domain aspel.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-18T22:30:52+00:00
Next Scan 2026-03-04T22:30:52+00:00

Last Successful Scan

Scanned2025-08-24T21:26:25+00:00
URL https://aspel.com/robots.txt
Redirect https://www.aspel.com.mx/robots.txt
Redirect Domain www.aspel.com.mx
Redirect Base aspel.com.mx
Domain IPs 104.21.58.154, 172.67.161.121, 2606:4700:3033::ac43:a179, 2606:4700:3037::6815:3a9a
Redirect IPs 13.248.168.249, 76.223.54.4
Response IP 13.248.168.249
Found Yes
Hash 80f1e79d378a1988dfb9b1b6775e7f801bc34d67c3358fb7157a21745c61c8e3
SimHash 814c5543d794

Groups

*
*

Rule Path
Allow /*.css
Allow /*.jpeg
Allow /*.js
Allow /*.png
Allow /*.webp
Allow /*.jpg
Allow /*.svg
Allow /*.woff
Allow /*.gif
Disallow /*cuenta/
Disallow /*gracias-compra
Disallow /*?token=
Disallow /*cupon%3D
Disallow /*recuperar-password?id

Other Records

Field Value
sitemap https://www.aspel.com.mx/sitemap.xml

Comments

  • ALLOWs QUE DEBEN ESTAR SIEMPRE
  • URLS QUE NO DEBEN APARECER
  • JSON RASTREABLES
  • DISALLOW URL PARAMETROS