www2.razerzone.com
robots.txt

Robots Exclusion Standard data for www2.razerzone.com

Resource Scan

Scan Details

Site Domain www2.razerzone.com
Base Domain razerzone.com
Scan Status Ok
Last Scan2024-11-14T02:58:04+00:00
Next Scan 2024-11-21T02:58:04+00:00

Last Scan

Scanned2024-11-14T02:58:04+00:00
URL https://www2.razerzone.com/robots.txt
Redirect https://www.razer.com:443/robots.txt
Redirect Domain www.razer.com
Redirect Base razer.com
Domain IPs 54.177.37.104, 54.193.190.207
Redirect IPs 104.16.190.67, 104.16.191.67, 2606:4700::6810:be43, 2606:4700::6810:bf43
Response IP 104.16.190.67
Found Yes
Hash e42951274ed521ac1d1b4c62429c6ef71e4eb8b1ac130fb5f6e3dddc862cc845
SimHash 3e567792eff8

Groups

*

Rule Path
Disallow /*?*
Disallow */search
Disallow */cart
Disallow */checkout
Disallow */my-account
Disallow */customs/browse
Disallow */thank*
Disallow */guest/order/*

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.razer.com/sitemap.xml
sitemap https://sitemap-xml.razer.com/pro-sitemaps-4237407.php?sn=sitemap_video.xml
sitemap https://sitemap-xml.razer.com/pro-sitemaps-4237407.php?sn=sitemap_images.xml
sitemap https://sitemap-xml.razer.com/pro-sitemaps-4237407.php?sn=sitemap1.xml
sitemap https://sitemap-xml.razer.com/pro-sitemaps-4237407.php?sn=sitemap2.xml
sitemap https://sitemap-xml.razer.com/pro-sitemaps-4237407.php?sn=sitemap3.xml

Comments

  • For all robots
  • Block access to specific groups of pages
  • Allow search crawlers to discover the sitemap
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Block Google
  • User-agent: Googlebot
  • Disallow: