mrkhatib.com
robots.txt

Robots Exclusion Standard data for mrkhatib.com

Resource Scan

Scan Details

Site Domain mrkhatib.com
Base Domain mrkhatib.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-01-17T08:00:54+00:00
Next Scan 2026-01-31T08:00:54+00:00

Last Successful Scan

Scanned2025-12-09T03:34:03+00:00
URL https://mrkhatib.com/robots.txt
Domain IPs 104.21.75.152, 172.67.178.106, 2606:4700:3032::ac43:b26a, 2606:4700:3035::6815:4b98
Response IP 172.67.178.106
Found Yes
Hash 038a9077f48d67bd000daf71c23fd1aa62598f6e59f182a48935f93c7ad5b23c
SimHash 694988404d93

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /*?add-to-cart=
Disallow /*?*add-to-cart=
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-content/uploads/wpforms/

Other Records

Field Value
sitemap https://mrkhatib.com/sitemap_index.xml

Comments

  • START WPFORMS BLOCK
  • ---------------------------
  • ---------------------------
  • END WPFORMS BLOCK