arabhistoryso.com
robots.txt

Robots Exclusion Standard data for arabhistoryso.com

Resource Scan

Scan Details

Site Domain arabhistoryso.com
Base Domain arabhistoryso.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-16T03:50:53+00:00
Next Scan 2025-06-15T03:50:53+00:00

Last Successful Scan

Scanned2025-02-16T03:49:28+00:00
URL https://arabhistoryso.com/robots.txt
Domain IPs 5.180.148.38
Response IP 5.180.148.38
Found Yes
Hash 6c31092ede9b186384fea7b013a6f24fbe60bc62c0551f2eb7234a72f2c22189
SimHash 12148940d921

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow *?ak_action=reject_mobile
Disallow *?source=post_page
Disallow *?wpamp
Disallow *?ajax-request=jnews
Disallow *?et_core_page_resource
Disallow *?unapproved=
Disallow *?acc=
Disallow *?language=
Disallow *?share=
Disallow *?fbclid=
Disallow *?wordfence_lh=
Disallow *?pid=

ahrefsbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /