superxtra.com
robots.txt

Robots Exclusion Standard data for superxtra.com

Resource Scan

Scan Details

Site Domain superxtra.com
Base Domain superxtra.com
Scan Status Ok
Last Scan2024-05-15T21:16:41+00:00
Next Scan 2024-06-14T21:16:41+00:00

Last Scan

Scanned2024-05-15T21:16:41+00:00
URL https://www.superxtra.com/robots.txt
Domain IPs 108.157.254.120, 108.157.254.127, 108.157.254.60, 108.157.254.75, 2600:9000:2753:0:1f:7a95:6cc0:93a1, 2600:9000:2753:2800:1f:7a95:6cc0:93a1, 2600:9000:2753:6600:1f:7a95:6cc0:93a1, 2600:9000:2753:6e00:1f:7a95:6cc0:93a1, 2600:9000:2753:8000:1f:7a95:6cc0:93a1, 2600:9000:2753:a200:1f:7a95:6cc0:93a1, 2600:9000:2753:c00:1f:7a95:6cc0:93a1, 2600:9000:2753:e00:1f:7a95:6cc0:93a1
Response IP 108.157.254.75
Found Yes
Hash 36b9a0d5178dcb9f8c9a896b050e3efc90e002afa705a6121f21f98560c7a4c7
SimHash 2450ca876bd1

Groups

*
googlebot
adsbot-google
googlebot-image
googlebot-mobile
googlebot-video

Rule Path
Allow /
Allow *.js
Allow *.css
Allow /*?map*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow *?utm*
Disallow /*?page*
Disallow *?order=OrderBy*
Disallow /search?_query=*

Other Records

Field Value
sitemap https://www.superxtra.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.
  • NoSeguir