syriahr.com
robots.txt
Robots Exclusion Standard data for syriahr.com
Resource Scan
Scan Details
| Site Domain | syriahr.com |
| Base Domain | syriahr.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-23T12:59:18+00:00 |
| Next Scan | 2024-11-21T12:59:18+00:00 |
Last Successful Scan
| Scanned | 2024-04-03T12:57:04+00:00 |
| URL | https://syriahr.com/robots.txt |
| Domain IPs | 104.26.10.90, 104.26.11.90, 172.67.69.132, 2606:4700:20::681a:a5a, 2606:4700:20::681a:b5a, 2606:4700:20::ac43:4584 |
| Response IP | 104.26.10.90 |
| Found | Yes |
| Hash | 3613bac77046603e20e890d05f8eba39e0fd4e9982fd3ca046ff01a482c8b68c |
| SimHash | 6009de2088b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.syriahr.com/sitemap.xml |
| sitemap | https://www.syriahr.com/sitemap.rss |