dailyhareef.com
robots.txt
Robots Exclusion Standard data for dailyhareef.com
Resource Scan
Scan Details
| Site Domain | dailyhareef.com |
| Base Domain | dailyhareef.com |
| Scan Status | Ok |
| Last Scan | 2025-12-27T11:15:57+00:00 |
| Next Scan | 2026-01-03T11:15:57+00:00 |
Last Scan
| Scanned | 2025-12-27T11:15:57+00:00 |
| URL | https://dailyhareef.com/robots.txt |
| Redirect | https://www.dailyhareef.com/robots.txt |
| Redirect Domain | www.dailyhareef.com |
| Redirect Base | dailyhareef.com |
| Domain IPs | 65.21.10.187 |
| Redirect IPs | 65.21.10.187 |
| Response IP | 65.21.10.187 |
| Found | Yes |
| Hash | 5bf0f87386125b86c0f918c82aa10d9c91d64ecc5d53d224f0f599b8dc1226fe |
| SimHash | 599d51c1b594 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
yandex
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/ |
| Disallow | /test-ad-code/ |
| Disallow | /xajax/ |
| Disallow | /ajax_post_update |
| Disallow | /ajax_post_pagination |
| Disallow | /ajax_author_type_pagination |
| Disallow | /ajax_block_pagination |
| Disallow | /ajax_poll_pagination |
| Disallow | /poll_entry_submission |
| Disallow | /parse_oembed_links |
| Disallow | /oembed |
| Disallow | /oembed_videos |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dailyhareef.com/sitemap_news.xml |
| sitemap | https://www.dailyhareef.com/sitemap_news_google.xml |
| sitemap | https://www.dailyhareef.com/sitemap.xml |