alhaythamgroup.com
robots.txt

Robots Exclusion Standard data for alhaythamgroup.com

Resource Scan

Scan Details

Site Domain alhaythamgroup.com
Base Domain alhaythamgroup.com
Scan Status Ok
Last Scan2025-12-09T01:28:50+00:00
Next Scan 2026-01-08T01:28:50+00:00

Last Scan

Scanned2025-12-09T01:28:50+00:00
URL https://alhaythamgroup.com/robots.txt
Domain IPs 179.61.189.98, 2a02:4780:15:7fd5:35d3:4688:455c:5bc1, 2a02:4780:38:1f38:65d:15e2:59ff:8174, 91.108.100.237
Response IP 191.101.228.39
Found Yes
Hash 1d2d0b4e5d3162604beb94f907f1106abea1fff4aeb3d269552baedc4ddaffd6
SimHash b1014a288617

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /en/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /my-orders/
Disallow /order-tracking/
Disallow /wishlist/
Disallow /wishlist-2/
Disallow /*add-to-cart%3D*
Disallow /products-test/
Disallow /?s=
Disallow /*?*filter*
Disallow /*?*sort*
Disallow /ourteam-sitemap.xml
Disallow /portfolio-sitemap.xml
Disallow /bwp_slider-sitemap.xml

Other Records

Field Value
sitemap https://alhaythamgroup.com/sitemap_index.xml

Comments

  • Block the incomplete English directory
  • Reduce crawl on transactional/system pages
  • Block unnecessary sitemaps (after noindex applied)