xmartifydubai.com
robots.txt

Robots Exclusion Standard data for xmartifydubai.com

Resource Scan

Scan Details

Site Domain xmartifydubai.com
Base Domain xmartifydubai.com
Scan Status Ok
Last Scan2025-05-23T00:05:38+00:00
Next Scan 2025-06-22T00:05:38+00:00

Last Scan

Scanned2025-05-23T00:05:38+00:00
URL https://xmartifydubai.com/robots.txt
Domain IPs 213.165.242.8
Response IP 213.165.242.8
Found Yes
Hash 2a8d89405639cf698bf80d064d85fc0e804f67d93506c076f8916dfc825b66c6
SimHash 4b013a82e2d2

Groups

*

Rule Path
Disallow

geedoproductsearch

Rule Path
Disallow /

bingbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10000

googlebot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /cart-3/
Disallow /checkout-3/
Disallow /my-account-4/
Disallow /track-order/
Disallow /ts_mega_menu/
Disallow /theme/
Disallow /?add_to_wishlist%2F

Other Records

Field Value
crawl-delay 100

*

Rule Path
Disallow /?s=
Disallow /search/

*

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /*?orderby-price
Disallow /*?orderby=rating
Disallow /*?orderby=date
Disallow /*?orderby=price-desc
Disallow /*?orderby=popularity
Disallow /*?filter
Disallow /*add-to-cart%3D*

*

Rule Path
Disallow *?p=*
Disallow *%26p%3D*
Disallow *%26preview%3D*
Disallow /search

Other Records

Field Value
sitemap https://xmartifydubai.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Block Woocommerce assets
  • Block Search assets
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 2 invalid lines.