philenews.com
robots.txt
Robots Exclusion Standard data for philenews.com
Resource Scan
Scan Details
| Site Domain | philenews.com |
| Base Domain | philenews.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-17T04:40:42+00:00 |
| Next Scan | 2024-10-17T04:40:42+00:00 |
Last Successful Scan
| Scanned | 2024-08-21T01:47:58+00:00 |
| URL | https://philenews.com/robots.txt |
| Domain IPs | 104.26.8.204, 104.26.9.204, 172.67.72.226, 2606:4700:20::681a:8cc, 2606:4700:20::681a:9cc, 2606:4700:20::ac43:48e2 |
| Response IP | 104.26.9.204 |
| Found | Yes |
| Hash | 22367785ea811df681e32f6af485442ab7c84ead3e383e016ab896739fbbc60a |
| SimHash | e02d1f42068e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /xmlrpc.php |
| Disallow | /wp-admin/ |
| Disallow | /trackback/ |
| Disallow | /feed/ |
| Disallow | /feed/$ |
| Disallow | */feed/ |
| Disallow | */feed/$ |
| Disallow | /?feed= |
| Disallow | /comments/feed |
| Disallow | /comments$ |
| Disallow | /wp-comments/ |
| Disallow | /wp-feed |
| Disallow | /signature/ |
| Disallow | *%26preview%3D* |
| Disallow | /author/ |
| Disallow | /search/ |
| Disallow | /*?* |
| Disallow | /*?s=* |
| Disallow | /cdn-cgi/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.philenews.com/news.xml |
| sitemap | https://www.philenews.com/sitemap.xml |
| sitemap | https://www.philenews.com/categories.xml |