zeusarsenal.com
robots.txt

Robots Exclusion Standard data for zeusarsenal.com

Resource Scan

Scan Details

Site Domain zeusarsenal.com
Base Domain zeusarsenal.com
Scan Status Ok
Last Scan2025-06-21T15:32:19+00:00
Next Scan 2025-07-21T15:32:19+00:00

Last Scan

Scanned2025-06-21T15:32:19+00:00
URL https://zeusarsenal.com/robots.txt
Domain IPs 172.66.40.150, 172.66.43.106, 2606:4700:3108::ac42:2896, 2606:4700:3108::ac42:2b6a
Response IP 172.66.43.106
Found Yes
Hash 23668f4a878c008e767cb9964a63943885e9b8f1591de3865034d8f003e299ab
SimHash 8964db0e0719

Groups

*

Rule Path
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /*SID%3D
Disallow /test-simple-product.html
Disallow /test-configurable-product.html
Disallow /pub/checkcookie.php
Disallow /pub/static/*/Magento_Checkout/*
Disallow /pub/static/*/Magento_Ui/*
Allow /pub/static/*/Magento_Ui/*/messageList.min.js
Allow /pub/static/*/Magento_Ui/*/messages.min.js
Allow /pub/static/*/Magento_Ui/*/column.min.js
Allow /pub/static/*/Magento_Ui/*/dnd.min.js
Allow /pub/static/*/Magento_Ui/*/listing.min.js
Disallow /review/product/listAjax/

Other Records

Field Value
sitemap https://zeusarsenal.com/sitemap.xml

Comments

  • Disable Common Magento Directories
  • new sitemaps
  • Disallow test product
  • Disallow Check Cookie URL
  • Disallow pub/static - TSP-451
  • Disallow Review AJAX URL