en-ae.ajmal.com
robots.txt

Robots Exclusion Standard data for en-ae.ajmal.com

Resource Scan

Scan Details

Site Domain en-ae.ajmal.com
Base Domain ajmal.com
Scan Status Ok
Last Scan2025-10-01T02:10:19+00:00
Next Scan 2025-10-31T02:10:19+00:00

Last Scan

Scanned2025-10-01T02:10:19+00:00
URL https://en-ae.ajmal.com/robots.txt
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 146.75.45.124
Found Yes
Hash 1a72e6ea4cc197e58e340d1bda55298d4aa7cfaa8f69cb22782f35f9c5f2cb1f
SimHash 688d79bbc698

Groups

*

Rule Path
Disallow /admin/
Disallow /checkout/
Disallow /customer/
Disallow /wishlist/
Disallow /cart/
Disallow /search/
Disallow /catalogsearch/
Disallow /customer/account/
Disallow /customer/section/
Disallow /newsletter/
Disallow /contact/
Disallow /privacy-policy-cookie-restriction-mode/
Disallow /index.php/
Disallow /*?p=
Disallow /*?SID=
Disallow /*%26limit%3D
Disallow /*mode%3D*
Disallow /*order%3D*
Disallow /*product_compare/
Disallow /*add-to-cart/
Disallow /*login/
Disallow /*logout/
Disallow /*sendfriend/
Disallow /*tag/
Disallow /*rest/V1/
Disallow /*rest/
Disallow /cgi-bin/
Disallow /searchResult?
Disallow /searchResult?keyword=
Disallow /*?utm_source=
Disallow /*?utm_medium=
Disallow /*?utm_campaign=
Disallow /*?utm_term=
Disallow /*?gclid=
Disallow /*?fbclid=
Disallow /*?___from_store=
Disallow /*?___store=
Disallow /*?dir=
Disallow /*?price=
Disallow /*?p=
Disallow /rss/
Disallow /rss/catalog/
Disallow /rss/catalog/new/
Disallow /rss/catalog/specials/
Disallow /rss/order/
Disallow /rss/order/new/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /customer/
Disallow /cart/
Disallow /checkout/
Disallow /search/

bingbot

Rule Path
Disallow /customer/
Disallow /cart/
Disallow /checkout/
Disallow /search/

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

oai-searchbot

Rule Path
Disallow /customer/
Disallow /cart/
Disallow /checkout/
Disallow /search/
Disallow /admin/

Other Records

Field Value
sitemap https://en-ae.ajmal.com/sitemap.xml

Comments

  • Disallow Crawling for Unnecessary Sections
  • Block Duplicate URLs & Parameterized URLs
  • Block Session & Tracking Parameters
  • Sitemap Location
  • Disallow RSS Feeds
  • Crawler Directives
  • User-Agent Specific Rules

Warnings

  • `request-rate` is not a known field.