asharq.com
robots.txt

Robots Exclusion Standard data for asharq.com

Resource Scan

Scan Details

Site Domain asharq.com
Base Domain asharq.com
Scan Status Ok
Last Scan2024-06-12T04:32:18+00:00
Next Scan 2024-06-19T04:32:18+00:00

Last Scan

Scanned2024-06-12T04:32:18+00:00
URL https://asharq.com/robots.txt
Domain IPs 52.84.229.127, 52.84.229.33, 52.84.229.48, 52.84.229.90
Response IP 52.84.229.48
Found Yes
Hash ae4d78909a2209ea3f242de72df971c28354d7becbf39c1729326b54f16a3731
SimHash c11dda42c711

Groups

*

Rule Path
Allow /
Disallow */search/?author=*
Disallow /en/*
Disallow /search/

Other Records

Field Value
sitemap https://asharq.com/sitemap.xml