drshahidi.com
robots.txt

Robots Exclusion Standard data for drshahidi.com

Resource Scan

Scan Details

Site Domain drshahidi.com
Base Domain drshahidi.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-20T00:46:10+00:00
Next Scan 2025-09-27T00:46:10+00:00

Last Successful Scan

Scanned2025-08-20T00:30:05+00:00
URL https://drshahidi.com/robots.txt
Domain IPs 103.26.237.125
Response IP 103.26.237.125
Found Yes
Hash 38e8f441b5219ace5e51ccd27a302e5ab606011d921731e31b5c86d4e210e9d1
SimHash 69010c00cd92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.drshahidi.com/sitemap_index.xml